-- Logs begin at Mon 2022-07-11 15:09:10 UTC, end at Mon 2022-07-11 16:36:23 UTC. -- Jul 11 15:41:00.171077 dv-cinder-797608-53-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 15:41:00.180470 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 15:41:00 2022] *** Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: nodename: dv-cinder-797608-53-iscsi Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: machine: x86_64 Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: clock source: unix Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: pcre jit disabled Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: detected number of CPU cores: 4 Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: current working directory: / Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: detected binary path: /usr/bin/uwsgi-core Jul 11 15:41:00.182440 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: your processes number limit is 47680 Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: your memory page size is 4096 bytes Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: detected max file descriptor number: 2048 Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: lock engine: pthread robust mutexes Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: thunder lock: enabled Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 15:41:00.183060 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 15:41:00.231508 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: Python main interpreter initialized at 0x55edbe9f99c0 Jul 11 15:41:00.231508 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: python threads support enabled Jul 11 15:41:00.231508 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: your server socket listen backlog is limited to 100 connections Jul 11 15:41:00.231508 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: your mercy for graceful operations on workers is 90 seconds Jul 11 15:41:00.231872 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 15:41:00.231945 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: *** Operational MODE: preforking *** Jul 11 15:41:00.232180 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: *** uWSGI is running in multiple interpreter mode *** Jul 11 15:41:00.232180 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: spawned uWSGI master process (pid: 109714) Jul 11 15:41:00.232420 dv-cinder-797608-53-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 15:41:00.235113 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: spawned uWSGI worker 1 (pid: 109715, cores: 1) Jul 11 15:41:00.235113 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: spawned uWSGI worker 2 (pid: 109716, cores: 1) Jul 11 15:41:00.235113 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 15:41:00.882817 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 15:41:00.885603 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 15:41:01.995203 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:41:01.995203 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: from cryptography.utils import int_from_bytes Jul 11 15:41:01.995956 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:41:01.995956 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: from cryptography.utils import int_from_bytes Jul 11 15:41:01.996085 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:41:01.996085 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: from cryptography.utils import int_from_bytes Jul 11 15:41:01.996485 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:41:01.996485 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: from cryptography.utils import int_from_bytes Jul 11 15:41:04.450328 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:41:04.450964 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:41:04.451048 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:41:04.451377 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:41:04.451447 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:41:04.451511 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:41:04.451591 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:41:04.451657 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:41:04.451948 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:41:04.452080 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.452155 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:41:04.452298 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.452593 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.452725 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.452900 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.452994 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453206 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453318 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453551 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453845 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.453936 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454143 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454242 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454482 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454606 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454776 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.454921 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455025 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455107 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455342 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455439 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-53-iscsi {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455654 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455757 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.455956 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456056 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-53-iscsi {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456267 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456385 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456592 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456692 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456894 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.456983 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457209 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457296 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457491 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457583 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457809 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.457983 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.458383 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.458490 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.458642 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.458729 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.458902 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459026 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459340 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459500 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459649 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459828 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.459958 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.460136 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.460600 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.460780 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.460917 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461097 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461240 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461399 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461548 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461719 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.461956 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-53-iscsi {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.462042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.462275 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.462398 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-53-iscsi {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.462586 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.462792 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463065 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463201 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463492 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463632 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463844 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.463988 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464138 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464254 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464487 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464605 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464811 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.464910 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465123 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465212 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465454 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465567 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465775 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.465863 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466095 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466192 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466419 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466521 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466725 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.466811 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467074 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467168 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467388 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467486 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467691 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.467776 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468002 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468113 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468321 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468442 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468578 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468743 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468893 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.468979 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469221 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469307 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469546 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469631 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469868 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.469966 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470113 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470203 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470359 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470446 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470659 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470752 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.470974 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471061 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471281 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471367 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471586 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471681 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.471909 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472007 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472202 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472317 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472521 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472608 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472826 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.472919 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473130 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473215 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473432 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473518 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473734 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.473828 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474048 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474182 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474356 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474443 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474664 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474747 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.474967 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475064 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475285 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475371 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475605 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475695 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.475908 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476002 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476213 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476325 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476569 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476664 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476881 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.476974 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477182 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477266 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477495 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477582 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477804 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.477897 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478103 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478187 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478505 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478631 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478809 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.478905 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479129 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479283 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479445 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479531 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479697 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479791 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.479981 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480066 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480277 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480417 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480601 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480703 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.480917 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481002 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481218 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481312 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481525 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481609 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481826 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.481912 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482123 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482216 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482427 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482512 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482730 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.482815 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483034 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483127 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483332 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483426 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483633 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483730 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.483932 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484023 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484238 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484344 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484564 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484651 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.484864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485035 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485184 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485278 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485489 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485574 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485791 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.485884 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486092 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486177 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486396 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486491 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486699 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.486792 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487007 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487100 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487307 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487399 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487607 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487700 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.487922 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488007 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488220 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488346 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488547 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488642 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488859 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.488945 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489163 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489248 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489468 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489555 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489769 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.489859 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490068 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490151 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490369 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490455 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490678 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490761 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.490977 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491060 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491277 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491361 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491574 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491665 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491871 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.491968 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492168 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492254 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492490 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492575 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492786 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.492888 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493083 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493167 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493375 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493466 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493686 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.493780 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494029 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494280 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494357 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494603 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494730 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.494911 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.495010 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.495213 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.495301 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.495533 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:41:04.495621 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.495864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.495964 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496193 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496280 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496552 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496868 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.496954 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497187 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497279 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497502 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497597 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497816 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.497903 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498123 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498209 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498436 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498531 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498749 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.498839 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499054 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499140 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499363 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499450 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499671 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499759 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.499987 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500095 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500324 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500494 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500640 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500728 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.500960 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501049 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501272 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501360 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501585 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501673 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501891 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.501991 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502206 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502294 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502514 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502607 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502834 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.502920 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503140 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503239 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503476 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503564 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503798 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.503894 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504114 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504201 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504447 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504552 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504764 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.504882 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505068 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505169 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505378 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505465 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505685 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.505850 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506003 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506099 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506320 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506404 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506628 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506725 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.506942 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507029 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507246 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507333 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507555 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507655 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507860 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.507954 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508167 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508254 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508499 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508607 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508823 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.508909 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509128 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509213 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509438 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509535 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509798 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.509992 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510391 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510475 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510570 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510651 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510730 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510808 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.510987 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511080 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511290 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511378 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511599 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511693 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511898 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.511983 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512203 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512319 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512529 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512616 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512842 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.512943 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513162 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513247 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513462 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513550 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513770 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.513863 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514079 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514166 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514382 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514467 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514743 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514854 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.514987 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515120 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515286 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515372 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515588 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515683 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.515892 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516024 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516191 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516277 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516521 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516608 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516830 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.516914 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517130 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517216 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517432 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517518 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517734 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.517820 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518032 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518126 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518342 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518443 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518645 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518738 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.518948 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519034 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519254 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519348 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519558 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519645 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519870 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.519964 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520176 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520265 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520518 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520609 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520842 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.520936 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521164 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521249 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521466 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521553 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521787 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.521882 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522180 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522396 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522482 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522693 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522786 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.522995 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523081 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523292 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523386 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523591 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523889 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.523982 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524190 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524275 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524512 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524599 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524847 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.524950 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.525107 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.525194 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.525706 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.525805 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.525886 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526073 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526163 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526379 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526476 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526684 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526779 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.526983 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527068 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527284 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527372 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527584 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527684 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.527923 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528011 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528225 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528354 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528592 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528734 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.528921 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529239 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529365 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529559 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529676 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.529989 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530183 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530299 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530491 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530610 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530801 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.530935 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531108 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531245 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531417 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531564 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531736 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.531873 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532046 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532194 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532386 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532527 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532697 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.532847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533015 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533153 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533321 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533469 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533636 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533807 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.533938 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534138 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534233 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534454 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534570 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534777 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.534966 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535088 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535209 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535400 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535528 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535708 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.535979 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536073 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536313 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536410 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536630 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536726 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.536938 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537024 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537246 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537339 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537551 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537638 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537862 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.537979 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538168 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538255 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538478 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538566 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538782 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.538870 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539180 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539394 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539478 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539708 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.539806 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540010 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540105 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540341 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540434 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540658 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.540742 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541110 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541287 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541425 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541605 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541713 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.541920 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542032 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542233 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542326 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542541 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542626 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542846 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.542940 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543157 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543249 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543472 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543564 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543784 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.543877 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544093 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544180 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544419 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544508 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544728 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.544822 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545041 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545138 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545334 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545487 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545622 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545766 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.545928 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546057 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546212 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546365 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546525 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546664 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546842 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.546978 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547147 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547284 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547458 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547598 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547761 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.547889 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548059 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548204 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548388 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548475 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548687 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548774 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.548992 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549078 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549291 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549379 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549591 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549678 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549888 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.549976 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550222 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550309 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550525 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550611 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550824 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.550928 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551135 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551221 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551447 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551532 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551750 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.551844 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552058 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552150 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552384 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552491 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552688 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.552787 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553003 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553091 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553310 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553398 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553612 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553708 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.553918 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554005 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554223 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554309 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554522 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554638 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554827 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.554933 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555178 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555275 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555435 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555522 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555738 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.555823 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.556041 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.556126 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.556362 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.556469 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.556958 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557056 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557276 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557363 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557598 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557839 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.557926 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558169 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558266 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558481 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558570 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558795 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.558882 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559114 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559201 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559430 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559518 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559757 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.559855 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560083 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560171 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560426 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560538 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560737 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.560842 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561041 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561136 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561345 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561432 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561650 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561744 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.561954 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562041 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562254 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562345 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562556 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562661 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562855 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.562940 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563156 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563249 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563454 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563548 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563754 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.563841 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564053 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564153 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564376 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564467 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564680 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564765 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.564979 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565078 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565290 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565407 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565590 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565688 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565892 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.565998 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566202 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566296 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566500 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566592 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566799 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.566902 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567098 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567192 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567434 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567536 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567733 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.567835 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568067 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568161 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568405 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568499 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568734 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.568822 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569038 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569123 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569345 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569431 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569649 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569743 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.569959 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570051 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570267 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570360 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570563 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570649 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570871 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.570956 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571176 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571269 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571485 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571569 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571780 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.571871 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572145 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572257 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572460 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572551 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572831 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.572926 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573063 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573156 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573371 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573458 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573671 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573763 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.573974 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574068 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574285 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574371 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574592 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574676 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574895 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.574989 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575203 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575303 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575505 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575601 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575802 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.575904 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576105 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576189 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576424 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576512 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576728 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.576820 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577024 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577108 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577323 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577408 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577623 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577710 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.577930 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578015 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578234 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578319 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578534 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578620 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578838 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.578922 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579151 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579247 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579450 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579536 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579748 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.579832 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580055 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580152 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580375 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580461 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580677 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580762 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.580983 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581079 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581294 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581385 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581598 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581684 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581896 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.581988 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582198 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582282 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582496 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582591 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582797 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.582884 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583096 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583181 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583398 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583490 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583696 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583781 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.583996 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584096 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584311 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584399 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584615 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584702 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584913 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.584998 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.585219 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.585633 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.585844 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.585949 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586143 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586236 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586445 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586539 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586744 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.586834 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.587080 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.587165 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.587378 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.587539 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.587821 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588054 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588125 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588190 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588478 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588598 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588796 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.588891 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589104 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589197 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589409 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589507 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589719 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.589804 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590017 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590102 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590323 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590409 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590625 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590711 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.590930 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591014 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591233 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591319 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591533 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591617 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591852 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.591936 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592159 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592252 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592493 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592591 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592799 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.592891 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593109 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593195 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593422 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593507 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593720 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.593803 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594025 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594111 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594333 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594417 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594634 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594727 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.594939 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595023 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595244 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595338 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595549 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595642 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.595926 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596045 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596161 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596260 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596494 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596600 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596803 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.596896 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597106 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597198 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597413 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597508 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597720 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.597805 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598021 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598106 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598335 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598428 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598639 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598732 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.598939 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599023 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599241 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599326 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599665 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599846 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.599979 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.600148 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.600310 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.600597 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.600685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.600908 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601003 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601217 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601302 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601519 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601604 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601827 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.601924 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602129 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602221 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602439 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602544 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602751 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.602849 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.603054 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.603142 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.603587 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.603700 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.603897 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604016 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604335 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604432 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604621 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604707 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.604922 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605028 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605224 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605309 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605530 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605616 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.605851 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606076 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606165 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606244 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606431 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606524 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606729 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.606816 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607046 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607162 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607349 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607475 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607667 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.607782 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608081 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608199 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608412 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608535 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608715 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.608848 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609122 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609215 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609429 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609523 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609735 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.609829 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610055 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610141 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610372 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610466 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610681 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610815 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.610979 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611071 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611286 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611372 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611592 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611690 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611915 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.611999 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612218 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612326 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612555 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612652 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612866 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.612951 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613167 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613253 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613486 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613579 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613805 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.613889 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614115 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614200 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614434 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614527 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614820 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.614912 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615146 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615231 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615454 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615539 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615757 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.615841 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616085 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616215 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616415 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616511 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616694 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.616782 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617003 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617109 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617305 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617393 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617606 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617700 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.617923 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618022 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618222 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618308 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618527 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618615 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618829 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.618949 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619198 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619630 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619720 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619799 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619889 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.619980 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620089 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620267 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620436 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620595 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620756 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.620920 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621078 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621231 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621366 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621550 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621689 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621868 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.621996 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622171 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622300 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622490 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622648 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622782 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.622915 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623086 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623214 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623388 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623524 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623689 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.623824 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624028 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624156 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624353 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624444 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624673 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.624759 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625000 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625324 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625418 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625629 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625714 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.625958 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626263 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626351 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626568 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626653 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626878 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.626963 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627182 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627270 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627484 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627567 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627785 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.627884 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628089 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628182 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628412 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628501 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628715 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.628810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629016 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629322 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629414 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629622 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629719 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.629925 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630010 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630225 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630317 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630525 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630622 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630828 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.630913 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631129 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631222 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631433 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631519 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631732 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.631818 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632036 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632121 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632355 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632454 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632691 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632777 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.632990 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633078 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633318 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633405 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633632 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633719 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.633948 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634032 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634268 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634364 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634629 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634714 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.634950 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635056 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635271 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635385 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635586 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635675 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.635902 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636002 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636214 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636332 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636548 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636687 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636863 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.636962 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.637174 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.637261 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.637480 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.637695 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.637780 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638025 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638112 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638341 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638428 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638657 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638888 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.638975 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639216 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639301 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639527 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639614 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639838 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.639925 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640148 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640235 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640485 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640573 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640796 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.640882 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641105 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641191 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641412 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641505 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641719 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.641815 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642026 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642112 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642349 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642442 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642663 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642747 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.642979 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643063 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643294 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643391 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643603 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643688 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643914 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.643999 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644222 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644356 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644557 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644653 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644869 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.644954 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645184 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645278 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645495 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645579 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645805 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.645897 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646112 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646205 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646421 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646521 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646729 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.646828 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647035 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647120 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647342 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647435 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647649 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647743 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.647957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648043 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648263 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648422 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648597 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648905 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.648997 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.649218 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.649302 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.649534 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.649628 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.649851 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.650051 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.650202 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.650387 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.650525 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.650976 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651085 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651198 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651337 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651444 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651647 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651745 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.651962 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652048 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652301 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652422 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652611 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652699 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.652916 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653004 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653225 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653327 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653533 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653620 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653833 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.653918 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654134 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654229 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654439 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654531 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654742 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.654839 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655039 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655144 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655354 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655441 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655664 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655885 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.655986 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.656239 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.656383 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.656605 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.656698 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.656969 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657128 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657298 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657469 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657626 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657781 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.657937 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658101 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658267 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658422 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658576 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658740 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.658886 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659044 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659203 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659361 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659513 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659666 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659823 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.659969 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660128 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660257 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660462 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660601 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660773 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.660904 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661077 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661205 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661388 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661520 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661692 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.661806 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662018 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662104 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662324 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662417 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662632 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662724 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.662937 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663030 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663247 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663340 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663551 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663637 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663855 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.663946 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664161 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664253 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664486 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664576 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664787 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.664871 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665179 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665385 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665478 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665689 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.665774 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666186 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666392 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666543 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666779 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666872 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.666985 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667074 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667287 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667372 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667594 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667682 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.667930 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668016 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668245 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668355 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668576 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668661 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668875 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.668961 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669185 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669272 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669490 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669589 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669833 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.669920 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.670151 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.670243 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.670475 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.670682 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.670823 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671013 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671133 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671336 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671657 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671752 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.671987 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672074 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672323 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672452 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672624 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672726 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.672929 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673018 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673245 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673331 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673546 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673635 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673847 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.673942 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674154 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674241 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674457 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674544 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674762 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.674849 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675068 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675156 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675373 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675461 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675680 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675766 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.675982 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676076 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676302 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676404 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676615 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676703 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.676921 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677026 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677223 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677312 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677524 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677610 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677824 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.677920 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678127 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678215 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678435 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678528 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678773 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.678861 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679087 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679173 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679397 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679483 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679704 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.679791 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680012 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680112 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680335 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680432 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680645 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680734 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.680950 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.681045 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.681254 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.681341 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.681697 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682084 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682084 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682231 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682310 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682470 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682559 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682792 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.682887 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683116 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683210 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683430 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683519 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683753 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.683841 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684078 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684166 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684415 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684505 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684736 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.684835 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685044 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685145 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685360 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685456 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685673 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685760 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.685997 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686091 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686324 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686409 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686630 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686717 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.686937 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687044 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687240 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687333 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687542 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687629 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687843 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.687931 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688148 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688241 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688474 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688561 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688781 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.688869 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689091 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689178 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689395 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689481 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689699 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.689787 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690001 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690086 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690300 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690387 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690599 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690694 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690897 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.690991 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691197 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691291 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691491 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691576 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691789 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.691873 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692089 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692194 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692409 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692499 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692707 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.692792 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693006 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693106 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693304 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693397 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693600 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693898 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.693994 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694194 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694288 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694577 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694786 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.694881 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695111 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695207 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695438 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695533 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695745 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.695831 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696060 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696153 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696388 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696477 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696707 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.696795 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697015 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697176 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697412 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697597 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697820 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.697915 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698152 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698254 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698460 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698568 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698770 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.698863 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699081 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699176 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699390 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699558 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699700 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.699805 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700005 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700093 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700391 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700504 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700642 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700731 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.700957 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701277 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701372 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701579 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701666 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.701897 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702021 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702212 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702308 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702518 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702604 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702827 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.702912 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703131 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703219 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703435 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703521 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703747 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.703846 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704052 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704139 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704379 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704468 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704686 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704784 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.704994 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705081 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705304 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705392 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705709 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.705922 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706007 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706246 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706332 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706549 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706647 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706871 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.706958 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707195 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707293 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707533 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707621 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707841 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.707934 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708164 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708259 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708500 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708590 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708806 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.708901 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.709049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:41:04.709143 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.709398 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:41:04.709636 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:41:04.771658 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO dbcounter [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Registered counter for database nova_api Jul 11 15:41:04.775554 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Registered counter for database nova_api Jul 11 15:41:04.891167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_db.sqlalchemy.engines [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.892932 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.898210 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writer thread running {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:04.899761 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:04.953106 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.context [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39cfca4d-45cc-4bb7-beae-846c4ae6fa69(cell1) {{(pid=109716) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 15:41:04.954064 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.context [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39cfca4d-45cc-4bb7-beae-846c4ae6fa69(cell1) {{(pid=109715) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 15:41:04.957004 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:41:04.957974 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:41:04.958593 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:41:04.959377 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:41:04.959523 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:41:04.960611 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:41:04.961801 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:41:04.962787 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_concurrency.lockutils [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:41:04.963817 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO dbcounter [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Registered counter for database nova_cell0 Jul 11 15:41:04.964791 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Registered counter for database nova_cell0 Jul 11 15:41:04.967683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO dbcounter [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Registered counter for database nova_cell1 Jul 11 15:41:04.968721 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Registered counter for database nova_cell1 Jul 11 15:41:04.975328 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_db.sqlalchemy.engines [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.977244 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.980026 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writer thread running {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:04.980308 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.984077 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_db.sqlalchemy.engines [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:04.986103 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:04.988169 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:05.119073 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writer thread running {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:05.128171 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO dbcounter [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Registered counter for database nova_cell0 Jul 11 15:41:05.131166 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO dbcounter [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Registered counter for database nova_cell0 Jul 11 15:41:05.138435 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_db.sqlalchemy.engines [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:05.142402 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:41:05.143670 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writer thread running {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:05.147444 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writer thread running {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:41:05.478080 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: WARNING keystonemiddleware.auth_token [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:41:05.485478 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: WARNING keystonemiddleware.auth_token [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:41:05.489399 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:41:05.497211 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:41:05.824981 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: WARNING keystonemiddleware.auth_token [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:41:05.830954 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: WARNING keystonemiddleware.auth_token [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:41:05.836599 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55edbe9f99c0 pid: 109716 (default app) Jul 11 15:41:05.838943 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:41:05.840136 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 11 15:41:05.840556 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Jul 11 15:41:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:41:05.850557 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:41:05.857257 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: WARNING keystonemiddleware.auth_token [None req-9fe77149-6024-44b7-baa8-981caabc30ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:41:05.862386 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55edbe9f99c0 pid: 109715 (default app) Jul 11 15:42:22.195872 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:22.196378 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 11 15:42:22.198084 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:22.213160 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.214299 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell0:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.215134 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell1:SELECT=3 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.216190 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:23.091090 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-d6c93c57-1ef6-4ea1-b346-446541372944 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:23.121038 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-d6c93c57-1ef6-4ea1-b346-446541372944 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917579 Jul 11 15:42:23.121803 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 15:42:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:25.350093 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:25.351124 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-a07c0dad-ff81-4dbf-90b0-09390a828ad5 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 11 15:42:25.352928 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:25.787981 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-911077d3-2f2a-434e-839c-4d1419498861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "swap": 0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:25.808497 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:42:25.808497 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: warnings.warn(msg) Jul 11 15:42:25.840399 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-911077d3-2f2a-434e-839c-4d1419498861 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482611 Jul 11 15:42:25.841451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:25.856070 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_api:SELECT=3 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:25.857480 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_cell0:SELECT=3 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:25.858534 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_cell1:SELECT=3 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:25.859984 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:26.066361 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-11ee3d46-f400-4db0-aad9-fdf05159754e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:26.068871 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:42:26.068871 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:42:26.132602 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-11ee3d46-f400-4db0-aad9-fdf05159754e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282281 Jul 11 15:42:26.133535 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 15:42:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:28.384419 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-911077d3-2f2a-434e-839c-4d1419498861 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:28.385694 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-911077d3-2f2a-434e-839c-4d1419498861 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Jul 11 15:42:28.386461 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:42:29.029610 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-23bcb679-8ed0-4d53-872f-146b4276eade admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "swap": 0, "name": "ds512M", "ram": 512}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:29.047784 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:42:29.047784 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:42:29.068328 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-23bcb679-8ed0-4d53-872f-146b4276eade admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.675596 Jul 11 15:42:29.076239 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:29.082128 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-16585792-7e5b-423e-94ec-a219ffad53a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:29.084025 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:42:29.084025 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: warnings.warn(msg) Jul 11 15:42:29.124756 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-16585792-7e5b-423e-94ec-a219ffad53a6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046807 Jul 11 15:42:29.126187 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 15:42:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:31.357852 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-23bcb679-8ed0-4d53-872f-146b4276eade admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:31.359207 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-23bcb679-8ed0-4d53-872f-146b4276eade admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 11 15:42:31.375077 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:31.766723 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-78311d99-1336-4d5a-b2c7-14cf2bcc2559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:31.786700 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-78311d99-1336-4d5a-b2c7-14cf2bcc2559 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421578 Jul 11 15:42:31.787434 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:31.800140 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-c7aba4a6-24e2-4b9e-9974-ed7f679ffe9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:31.823242 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-c7aba4a6-24e2-4b9e-9974-ed7f679ffe9c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027296 Jul 11 15:42:31.823800 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 15:42:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:34.073724 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-78311d99-1336-4d5a-b2c7-14cf2bcc2559 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:34.074751 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-78311d99-1336-4d5a-b2c7-14cf2bcc2559 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 11 15:42:34.075207 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:34.584206 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-56f97a1e-5dbe-4f89-9228-ce8625575ee2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 2}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:34.611461 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-56f97a1e-5dbe-4f89-9228-ce8625575ee2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528454 Jul 11 15:42:34.612023 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:34.625033 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-8fcd68ae-b2e3-4fbc-b7ab-e6e9dacefaf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:34.655636 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-8fcd68ae-b2e3-4fbc-b7ab-e6e9dacefaf0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035121 Jul 11 15:42:34.656963 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 15:42:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:42:36.897321 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-56f97a1e-5dbe-4f89-9228-ce8625575ee2 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:36.898360 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-56f97a1e-5dbe-4f89-9228-ce8625575ee2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 11 15:42:36.898782 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:37.358071 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:37.376563 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472068 Jul 11 15:42:37.377215 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:37.389069 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-75aff87f-d745-4c32-93bd-295baf4a2e41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:37.414878 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-75aff87f-d745-4c32-93bd-295baf4a2e41 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029330 Jul 11 15:42:37.415522 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 15:42:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:39.991111 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:39.992937 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002418 Jul 11 15:42:39.993423 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:40.437099 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-eb2c4b1c-05ad-42ea-bf22-be4ff222ac0e admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:40.462301 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-eb2c4b1c-05ad-42ea-bf22-be4ff222ac0e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462091 Jul 11 15:42:40.462963 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 15:42:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:42:42.837044 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:42.837953 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-4b213baf-1275-435d-9e73-6780f6007833 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Jul 11 15:42:42.838364 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:43.329885 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-848aac3b-c93e-4390-b2ff-c0794b2f3e80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "swap": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:43.350026 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-848aac3b-c93e-4390-b2ff-c0794b2f3e80 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.504399 Jul 11 15:42:43.350800 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:43.366080 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-45383e03-c5db-4313-94fa-23a9d45d63fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:43.393614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-45383e03-c5db-4313-94fa-23a9d45d63fc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032155 Jul 11 15:42:43.394309 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 15:42:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:45.706530 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-848aac3b-c93e-4390-b2ff-c0794b2f3e80 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:45.707641 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-848aac3b-c93e-4390-b2ff-c0794b2f3e80 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 11 15:42:45.708070 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:46.117165 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-d57eabcf-0b7b-49c4-be01-b3284f814fb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "id": "2"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:46.137767 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-d57eabcf-0b7b-49c4-be01-b3284f814fb2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423076 Jul 11 15:42:46.138346 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:46.150369 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-1332ede9-b9bc-493f-8633-65130dc9385e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:46.174262 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-1332ede9-b9bc-493f-8633-65130dc9385e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027701 Jul 11 15:42:46.174801 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 15:42:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:48.562201 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-d57eabcf-0b7b-49c4-be01-b3284f814fb2 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:48.563449 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-d57eabcf-0b7b-49c4-be01-b3284f814fb2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jul 11 15:42:48.563949 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:48.941420 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-935a0861-e385-401f-bded-04916f69b0ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:48.961613 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-935a0861-e385-401f-bded-04916f69b0ff admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.391726 Jul 11 15:42:48.969835 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:48.974817 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-2bfe5627-a71a-4169-abab-d656dc3cb7fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:49.001866 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-2bfe5627-a71a-4169-abab-d656dc3cb7fa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029873 Jul 11 15:42:49.002817 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 15:42:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:42:51.224789 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-935a0861-e385-401f-bded-04916f69b0ff admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:51.226070 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-935a0861-e385-401f-bded-04916f69b0ff admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 11 15:42:51.226351 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:51.650938 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-e8b0585b-6f7f-45f6-ba4b-88a223176f65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "id": "4"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:51.675371 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-e8b0585b-6f7f-45f6-ba4b-88a223176f65 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442942 Jul 11 15:42:51.675951 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:42:51.688021 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-b6efe7e9-10b5-4552-b639-38e8cfc808fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:51.714051 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-b6efe7e9-10b5-4552-b639-38e8cfc808fd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029722 Jul 11 15:42:51.714840 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 15:42:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:42:53.953285 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-e8b0585b-6f7f-45f6-ba4b-88a223176f65 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:42:53.954848 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-e8b0585b-6f7f-45f6-ba4b-88a223176f65 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Jul 11 15:42:53.955489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:42:54.506960 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:54.528710 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.566314 Jul 11 15:42:54.529368 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 15:42:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:42:54.541682 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-429191bf-282b-43a4-9a90-5a33bf992c92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:42:54.545566 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:54.568498 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-429191bf-282b-43a4-9a90-5a33bf992c92 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030692 Jul 11 15:42:54.570114 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 15:42:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:13.418393 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:13.419412 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 11 15:43:13.419816 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:13.853991 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-7c914518-cee1-49c2-8504-7cf5b9d09474 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:13.870763 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-7c914518-cee1-49c2-8504-7cf5b9d09474 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.445068 Jul 11 15:43:13.871279 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 15:43:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:43:14.951396 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:14.952439 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-41b237a4-dfd4-4e9d-8a32-a4b915c5e98a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 11 15:43:14.952843 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:15.502671 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-381787c3-9427-432f-b80d-751efe93b5dc admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:15.508596 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-381787c3-9427-432f-b80d-751efe93b5dc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-381787c3-9427-432f-b80d-751efe93b5dc admin admin] Request method failure captured: Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Host: 10.222.0.26 Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABizEUSuCBzzdNkYfa5ZlbWf84uzvkMDUZWZ5JjXaWn8VayngpGOuCjyi4vuOoBRR1PaHp0seqZlPhW5a_qj26R9RDCXZ4gdkoryLpPW_IRSXlL791MchYZ_WN5Pc48Lh7yQnxz5BR6_aXGEWQLCWsGXD5tYMrBvCq3xze0b6-waZIf0os Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Role: member,reader,admin Jul 11 15:43:15.511870 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Roles: member,reader,admin Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User: admin Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: method: > Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: exception: Flavor 42 could not be found. Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: action_args: {'id': '42'} Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:15.513660 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:15.514614 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.515864 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-381787c3-9427-432f-b80d-751efe93b5dc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:15.517021 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-381787c3-9427-432f-b80d-751efe93b5dc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.424160 Jul 11 15:43:15.517021 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 15:43:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:15.523318 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-23d9d972-d05b-43a7-aeee-2ef0ccd8b4f5 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:15.526421 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:15.546991 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-23d9d972-d05b-43a7-aeee-2ef0ccd8b4f5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027539 Jul 11 15:43:15.547565 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:43:15.557780 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-f59ce8c6-bd01-4be5-9d83-49ce6f26cd30 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:15.579044 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-f59ce8c6-bd01-4be5-9d83-49ce6f26cd30 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024895 Jul 11 15:43:15.579589 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:43:15.592598 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-ccc107ab-fad9-4ac8-8618-b6d428d846d4 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:15.600958 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.wsgi [None req-ccc107ab-fad9-4ac8-8618-b6d428d846d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-ccc107ab-fad9-4ac8-8618-b6d428d846d4 admin admin] Request method failure captured: Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept: application/json Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept-Encoding: gzip, deflate Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Connection: keep-alive Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Content-Length: 0 Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Host: 10.222.0.26 Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-System-Scope: None Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: User-Agent: python-novaclient Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Auth-Token: gAAAAABizEUSuCBzzdNkYfa5ZlbWf84uzvkMDUZWZ5JjXaWn8VayngpGOuCjyi4vuOoBRR1PaHp0seqZlPhW5a_qj26R9RDCXZ4gdkoryLpPW_IRSXlL791MchYZ_WN5Pc48Lh7yQnxz5BR6_aXGEWQLCWsGXD5tYMrBvCq3xze0b6-waZIf0os Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Id: None Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Name: None Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Identity-Status: Confirmed Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Is-Admin-Project: True Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Id: default Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Name: Default Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Name: admin Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Role: member,reader,admin Jul 11 15:43:15.606167 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Roles: member,reader,admin Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant: admin Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Name: admin Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User: admin Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Id: default Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Name: Default Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Name: admin Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: method: > Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: exception: Flavor 42 could not be found. Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: action_args: {'id': '42'} Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:15.608234 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:15.609566 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:15.611483 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-ccc107ab-fad9-4ac8-8618-b6d428d846d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:15.613429 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-ccc107ab-fad9-4ac8-8618-b6d428d846d4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021537 Jul 11 15:43:15.613429 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 15:43:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:16.597876 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-f59ce8c6-bd01-4be5-9d83-49ce6f26cd30 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:16.598921 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-f59ce8c6-bd01-4be5-9d83-49ce6f26cd30 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 11 15:43:16.599310 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:17.158677 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-cd225e6d-fdc5-4435-be2b-df558366f941 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:17.164565 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.wsgi [None req-cd225e6d-fdc5-4435-be2b-df558366f941 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-cd225e6d-fdc5-4435-be2b-df558366f941 admin admin] Request method failure captured: Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept: application/json Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept-Encoding: gzip, deflate Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Connection: keep-alive Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Content-Length: 0 Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Host: 10.222.0.26 Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-System-Scope: None Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: User-Agent: python-novaclient Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Auth-Token: gAAAAABizEUUc86l5kJourJKkQ-Ak1mKgdZIKeQQeQicDf8GKlw1zdb895TEaJ7Qq56xRE2J3UdM7WPK2BCguUrsnluQJ8pTA9_08FWBe0JTVaF8aru6cpC1pqfFrps0cGCdl3_T1zwbZ0fkxMNrt2JtUFZnLhdzhjT8JSPP-wlJC0MGqmhnBFA Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Id: None Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Name: None Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Identity-Status: Confirmed Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Is-Admin-Project: True Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Id: default Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Name: Default Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Name: admin Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Role: member,reader,admin Jul 11 15:43:17.166101 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Roles: member,reader,admin Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant: admin Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Name: admin Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User: admin Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Id: default Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Name: Default Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Name: admin Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: method: > Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: exception: Flavor 84 could not be found. Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: action_args: {'id': '84'} Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:17.167623 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:17.168545 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.169847 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-cd225e6d-fdc5-4435-be2b-df558366f941 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:17.171107 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-cd225e6d-fdc5-4435-be2b-df558366f941 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432642 Jul 11 15:43:17.171107 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 15:43:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:17.177355 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-1b130517-abce-4104-a2d8-3898920dcb39 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:17.197580 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-1b130517-abce-4104-a2d8-3898920dcb39 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023821 Jul 11 15:43:17.198135 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:43:17.207974 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-719cbb17-52e2-42f6-ac18-f3f01547150b admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:17.222857 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-719cbb17-52e2-42f6-ac18-f3f01547150b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018497 Jul 11 15:43:17.223376 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:43:17.235331 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-47aa35a1-c5ea-466b-98a6-c7ca19534645 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:17.242714 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-47aa35a1-c5ea-466b-98a6-c7ca19534645 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-47aa35a1-c5ea-466b-98a6-c7ca19534645 admin admin] Request method failure captured: Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Host: 10.222.0.26 Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABizEUUc86l5kJourJKkQ-Ak1mKgdZIKeQQeQicDf8GKlw1zdb895TEaJ7Qq56xRE2J3UdM7WPK2BCguUrsnluQJ8pTA9_08FWBe0JTVaF8aru6cpC1pqfFrps0cGCdl3_T1zwbZ0fkxMNrt2JtUFZnLhdzhjT8JSPP-wlJC0MGqmhnBFA Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Role: member,reader,admin Jul 11 15:43:17.245042 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Roles: member,reader,admin Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User: admin Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: method: > Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: exception: Flavor 84 could not be found. Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: action_args: {'id': '84'} Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:17.246489 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:17.248214 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:17.249541 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-47aa35a1-c5ea-466b-98a6-c7ca19534645 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:17.250760 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-47aa35a1-c5ea-466b-98a6-c7ca19534645 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016938 Jul 11 15:43:17.250760 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 15:43:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 11 15:43:18.248359 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-719cbb17-52e2-42f6-ac18-f3f01547150b admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:18.249637 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-719cbb17-52e2-42f6-ac18-f3f01547150b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Jul 11 15:43:18.250033 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:18.805138 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4396bf66-e279-47e0-a081-2e56916bb604 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:18.810923 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.wsgi [None req-4396bf66-e279-47e0-a081-2e56916bb604 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4396bf66-e279-47e0-a081-2e56916bb604 admin admin] Request method failure captured: Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept: application/json Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Accept-Encoding: gzip, deflate Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Connection: keep-alive Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Content-Length: 0 Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Host: 10.222.0.26 Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Openstack-System-Scope: None Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: User-Agent: python-novaclient Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Auth-Token: gAAAAABizEUW6AlLWEykK-MKRNeMzFcx5MEz77D5rQ8hI4yGeXjkTDRhmMzFwK_P5ZZP38Cxyyj5W5w5iIk48PV74D5uDkn0HcR9LrYBhcZGE48tESnTd7mSgC65f09-gh4_6-Ninq9TF9nluPkYvXXHV--rkxu0EElD8PvpK7pWD-USWYlT3OU Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Id: None Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Domain-Name: None Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Identity-Status: Confirmed Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Is-Admin-Project: True Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Id: default Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Domain-Name: Default Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Project-Name: admin Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Role: member,reader,admin Jul 11 15:43:18.812451 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Roles: member,reader,admin Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant: admin Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-Tenant-Name: admin Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User: admin Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Id: default Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Domain-Name: Default Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: X-User-Name: admin Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: method: > Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: exception: Flavor 451 could not be found. Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: action_args: {'id': '451'} Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:18.813957 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:18.814790 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.815810 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-4396bf66-e279-47e0-a081-2e56916bb604 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:18.817107 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-4396bf66-e279-47e0-a081-2e56916bb604 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.427109 Jul 11 15:43:18.817107 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:43:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:18.823901 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-fdde1fce-af00-4e67-8a73-c45357ac86fb admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:18.837924 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-fdde1fce-af00-4e67-8a73-c45357ac86fb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017710 Jul 11 15:43:18.838470 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:43:18.847727 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:18.862932 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018655 Jul 11 15:43:18.863463 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 15:43:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:43:18.875267 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-1eb4e54a-d241-464e-85f2-e9959d07bbfb admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:18.882542 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.wsgi [None req-1eb4e54a-d241-464e-85f2-e9959d07bbfb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-1eb4e54a-d241-464e-85f2-e9959d07bbfb admin admin] Request method failure captured: Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept: application/json Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Accept-Encoding: gzip, deflate Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Connection: keep-alive Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Content-Length: 0 Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Host: 10.222.0.26 Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-Api-Version: compute 2.90 Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Openstack-System-Scope: None Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: User-Agent: python-novaclient Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Auth-Token: gAAAAABizEUW6AlLWEykK-MKRNeMzFcx5MEz77D5rQ8hI4yGeXjkTDRhmMzFwK_P5ZZP38Cxyyj5W5w5iIk48PV74D5uDkn0HcR9LrYBhcZGE48tESnTd7mSgC65f09-gh4_6-Ninq9TF9nluPkYvXXHV--rkxu0EElD8PvpK7pWD-USWYlT3OU Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Id: None Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Domain-Name: None Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Identity-Status: Confirmed Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Is-Admin-Project: True Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Id: default Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Domain-Name: Default Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Project-Name: admin Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Role: member,reader,admin Jul 11 15:43:18.884049 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Roles: member,reader,admin Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea74c7f2a67041fea527ddf55a3384ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea74c7f2a67041fea527ddf55a3384ec"}]}] Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant: admin Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Id: ea74c7f2a67041fea527ddf55a3384ec Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-Tenant-Name: admin Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User: admin Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Id: default Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Domain-Name: Default Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Id: db61f34a47204afa92fb860bcaecb5da Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: X-User-Name: admin Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: method: > Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: exception: Flavor 451 could not be found. Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: action_args: {'id': '451'} Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:43:18.885685 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:18.886520 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: ERROR nova.api.openstack.wsgi Jul 11 15:43:18.887683 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-1eb4e54a-d241-464e-85f2-e9959d07bbfb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:43:18.888715 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-1eb4e54a-d241-464e-85f2-e9959d07bbfb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015902 Jul 11 15:43:18.888715 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:43:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 11 15:43:19.899001 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:19.900005 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 11 15:43:19.900416 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:20.457005 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-8a5b1eef-c019-4047-bdce-d0cb8b5b9b3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:43:20.481190 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-8a5b1eef-c019-4047-bdce-d0cb8b5b9b3a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.442469 Jul 11 15:43:20.481810 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 15:43:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:43:21.487304 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:21.488331 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 11 15:43:21.488720 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:22.070323 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-b267aaae-ffa3-48e9-9f57-da968ed6f665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:43:22.094857 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-b267aaae-ffa3-48e9-9f57-da968ed6f665 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469715 Jul 11 15:43:22.095639 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 15:43:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:43:23.100179 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:23.101241 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 11 15:43:23.101631 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:23.686473 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-f9fa304d-2fa3-4d2b-980b-a3236bca6b40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:43:23.713357 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-f9fa304d-2fa3-4d2b-980b-a3236bca6b40 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.476437 Jul 11 15:43:23.713901 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 15:43:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:43:24.702308 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:24.703327 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 11 15:43:24.703888 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:25.265377 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-8ea75fa2-7a99-443a-9fc0-e49d15d0d77f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:43:25.285907 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-8ea75fa2-7a99-443a-9fc0-e49d15d0d77f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.444995 Jul 11 15:43:25.286461 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 15:43:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:43:26.272061 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:26.273616 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Jul 11 15:43:26.274225 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:43:26.827253 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-ed64010a-7e90-4cec-96a3-676b2cf253f9 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:43:26.848469 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-ed64010a-7e90-4cec-96a3-676b2cf253f9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432451 Jul 11 15:43:26.848998 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Jul 11 15:43:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:44:19.012784 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.013818 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-15d6da78-d609-44e7-9a74-8a242f6463f5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 11 15:44:19.014232 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:44:19.021632 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.436950 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-7f9c8649-e40c-4b07-b7af-30b3e246e18f admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.456006 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-7f9c8649-e40c-4b07-b7af-30b3e246e18f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435536 Jul 11 15:44:19.456565 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:44:19.485158 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG dbcounter [-] [109715] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.490619 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-8e9d5fb1-80f5-433d-8958-139e6193cea9 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.502456 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-8e9d5fb1-80f5-433d-8958-139e6193cea9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019485 Jul 11 15:44:19.503182 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:19.515245 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-25411fbb-8022-4e18-a285-718499de0295 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.523896 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-25411fbb-8022-4e18-a285-718499de0295 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 Jul 11 15:44:19.524494 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:19.536449 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.544686 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012054 Jul 11 15:44:19.545211 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:19.557370 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-2aa6f739-7575-4312-bf08-59f9b8a25f94 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:44:19.565071 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-2aa6f739-7575-4312-bf08-59f9b8a25f94 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011267 Jul 11 15:44:19.565532 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 11 15:44:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:47:39.360935 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:39.361967 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jul 11 15:47:39.362367 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:47:39.499696 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_api:SELECT=6 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:39.681231 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:39.682392 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:47:39.682392 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:47:39.683581 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:39.684012 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:39.684841 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:39.685291 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:39.718634 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-4ec600fc-97c4-4e52-80ad-19c495b3cdc7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.220381 Jul 11 15:47:39.719158 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:47:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:47:40.564469 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:40.565488 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Jul 11 15:47:40.565903 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:47:40.773873 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:40.775046 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:47:40.775046 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:47:40.776224 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:40.776684 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:40.777448 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:40.777875 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:40.797350 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-a1b50b78-8a15-4681-b714-32ecdd0f4522 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091619 Jul 11 15:47:40.797970 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:47:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:47:52.057820 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:52.058828 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 11 15:47:52.059281 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:47:52.204340 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_cell0:SELECT=4 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:52.205075 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_cell1:SELECT=4 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:52.205772 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG dbcounter [-] [109716] Writing DB stats nova_api:SELECT=8 {{(pid=109716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:52.266707 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:52.267834 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:47:52.267834 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:47:52.269035 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:52.269468 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:52.270241 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:52.270659 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:52.299891 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-99dc4147-caca-4be1-b3ae-472fff5e7b9d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.102110 Jul 11 15:47:52.300462 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:47:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:47:53.137664 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: DEBUG nova.api.openstack.wsgi [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] Calling method '>' {{(pid=109715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:53.138715 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: INFO nova.api.openstack.requestlog [None req-827f5a47-f3e5-4b7c-a50e-f1acb4b3f096 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 11 15:47:53.139116 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: [pid: 109715|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 15:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:47:53.349606 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG nova.api.openstack.wsgi [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] Calling method '>' {{(pid=109716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:47:53.350781 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:47:53.350781 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: warnings.warn(msg) Jul 11 15:47:53.351969 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:53.352437 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:53.353224 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:47:53.353652 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: DEBUG oslo_concurrency.lockutils [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:47:53.376502 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: INFO nova.api.openstack.requestlog [None req-9dc5b9b1-0e90-4437-adb3-3e81f1f36457 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.097046 Jul 11 15:47:53.377061 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: [pid: 109716|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 15:47:53 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:48:48.389289 dv-cinder-797608-53-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 11 15:48:48.389899 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: Mon Jul 11 15:48:48 2022 - graceful shutdown triggered... Jul 11 15:48:48.390587 dv-cinder-797608-53-iscsi devstack@n-api.service[109715]: Gracefully killing worker 1 (pid: 109715)... Jul 11 15:48:48.390947 dv-cinder-797608-53-iscsi devstack@n-api.service[109716]: Gracefully killing worker 2 (pid: 109716)... Jul 11 15:48:49.390903 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: worker 1 buried after 1 seconds Jul 11 15:48:49.390903 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: worker 2 buried after 1 seconds Jul 11 15:48:49.390903 dv-cinder-797608-53-iscsi devstack@n-api.service[109714]: goodbye to uWSGI. Jul 11 15:48:49.393728 dv-cinder-797608-53-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 11 15:48:49.394709 dv-cinder-797608-53-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 11 15:48:49.399101 dv-cinder-797608-53-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 15:48:49.415536 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 15:48:49 2022] *** Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: nodename: dv-cinder-797608-53-iscsi Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: machine: x86_64 Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: clock source: unix Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: pcre jit disabled Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: detected number of CPU cores: 4 Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: current working directory: / Jul 11 15:48:49.417626 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: detected binary path: /usr/bin/uwsgi-core Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: your processes number limit is 47680 Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: your memory page size is 4096 bytes Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: detected max file descriptor number: 2048 Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: lock engine: pthread robust mutexes Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: thunder lock: enabled Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 15:48:49.418354 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 15:48:49.469665 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: Python main interpreter initialized at 0x55bc97e3c9c0 Jul 11 15:48:49.469665 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: python threads support enabled Jul 11 15:48:49.469665 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: your server socket listen backlog is limited to 100 connections Jul 11 15:48:49.469665 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: your mercy for graceful operations on workers is 90 seconds Jul 11 15:48:49.470148 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 15:48:49.470148 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: *** Operational MODE: preforking *** Jul 11 15:48:49.470377 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: *** uWSGI is running in multiple interpreter mode *** Jul 11 15:48:49.470377 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: spawned uWSGI master process (pid: 124221) Jul 11 15:48:49.470782 dv-cinder-797608-53-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 15:48:49.471474 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: spawned uWSGI worker 1 (pid: 124241, cores: 1) Jul 11 15:48:49.471794 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: spawned uWSGI worker 2 (pid: 124242, cores: 1) Jul 11 15:48:49.473004 dv-cinder-797608-53-iscsi devstack@n-api.service[124221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 15:48:50.129708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 15:48:50.130383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 15:48:51.319810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:48:51.319810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: from cryptography.utils import int_from_bytes Jul 11 15:48:51.320609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:48:51.320609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: from cryptography.utils import int_from_bytes Jul 11 15:48:51.329790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:48:51.329790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: from cryptography.utils import int_from_bytes Jul 11 15:48:51.330326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:48:51.330326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: from cryptography.utils import int_from_bytes Jul 11 15:48:53.640613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:48:53.641284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:48:53.641366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:48:53.641756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:48:53.641987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:48:53.642493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.642803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.643322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.643628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.643999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.644322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.644666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.644993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.645332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.645577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.645917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.646231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-53-iscsi {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.646581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.647161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.647484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.647809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.648120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.648476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.648787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.649285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.650617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.650617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.650617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.651270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.651270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.651270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.651858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.652065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.652273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.652529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.652958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-53-iscsi {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.653280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.653603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.653922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.654343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.654663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.654966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.655303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.655632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.655933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.656307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.656630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.656959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.657289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.657585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.657970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.658438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.658769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.659087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.659401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.659657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.659969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.660355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.660656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.660990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.661243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.661501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.661809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.662137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.662450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.662797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.663084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.663380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.663690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.664000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.664389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.664639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.664967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.665288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.665614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.665924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.666267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.666658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.666913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.667240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.667575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.667899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.668213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.668564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.668892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.669207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.669522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.669831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.670047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:48:53.670539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.670696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:48:53.670844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.670844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.671129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:48:53.671270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.671442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:48:53.671592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.671740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:48:53.671882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.672798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.673880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.674994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.675900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-53-iscsi {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.676042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.676203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.676436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.676611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.676847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.677981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.678876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.679858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.680914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.681952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-53-iscsi {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.682964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.683181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.683181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.683570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.683713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.683852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.684889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.685948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.686087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.686311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.686471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.686689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.686860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.687088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.687253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.687410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.687552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.687708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.687910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.688060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.688200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.688200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.688509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.688651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.688798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.688949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.689130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.689304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.689464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.689613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.689844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.689844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.690133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.690278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.690418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.690567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.690716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.690859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.691017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.691169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.691309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.691451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.691590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.691743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.691891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.692030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.692170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.692369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.692516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.692675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.692815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.692965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.693104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.693324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.693557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.693714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.693855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.694003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.694154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.694302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.694449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.694599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.694748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.694748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.695128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.695283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.695433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.695433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.695707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.695707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.695993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.696137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.696302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.696302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.696597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.696830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.696995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.697230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.697391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.697391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.697671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.697812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.698030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.698174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.698322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.698463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.698602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.698749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.698892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.699200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.699200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.699480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.699627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.699767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.699767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.700139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.700280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.700475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.700623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.700773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.700928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.701081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.701221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.701384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.701631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.701791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.701948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.702103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.702242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.702381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.702521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.702674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.702814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.702962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.703113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.703253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.703471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.703708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.703855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.703996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.704146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.704922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.705084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.705351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.705519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.705718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.705874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.706023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.706172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.706329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.706329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.706329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.706730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.706966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.707127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.707270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.707422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.707562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.707708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.707867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.708194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.708470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.708642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.708785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.708925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.709073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.709212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.709353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.709797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.709941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.710176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.710343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.710496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.710637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.710776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.710916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.711070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.711218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.711368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.711510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.711657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.711797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.711945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.712086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.712233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.712418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.712570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.712721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.712874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.713022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.713162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.713162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.713428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.713675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.713977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.714124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.714273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.714423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.714562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.714716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.714857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.715002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.715151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.715290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.715541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.715697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.715845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.715985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.716123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.716278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.716467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.716624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.716766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.716905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.717130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.717281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:48:53.717423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.717576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.717726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.717726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.718916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.719936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.720076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.720424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.720661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.720889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.721927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.722962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.723113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.723262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.723410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.723549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.723774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.724943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.725958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.726995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.727972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.728112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.728254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.728580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.728722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.728874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.729933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.730917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.731918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.732981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.733940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.734902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.735814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.736068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.736259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.736442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.736585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.736889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.737868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.738916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.739937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.740920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.741894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.742776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.743859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.744929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.745956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.746925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.747200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.747348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.747508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.747739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.747892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.748041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.748182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.749954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.750948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.751103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.751252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.751402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.751402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.751402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.752931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.753975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.754215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.754463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.754616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.754771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.754929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.755992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.756270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.756553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.756717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.756877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.757913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.758990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.759155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.759474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.759741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.759910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.760984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.761139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.761293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.761456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.761618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.761849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.762926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.763864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.764019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.764263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.764481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.764702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.764862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.765942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.766998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.767194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.767372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.767567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.767765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.767943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.768172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.768377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.768544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.768701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.768848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.769991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.770925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.771943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.772870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.773897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.774043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.774211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.774453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.774622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.774861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.775947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.776101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.776256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.776497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.776665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.776838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.777914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.778875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.779969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.780128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.780283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.780520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.780678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.780846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.781857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.782996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.783911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.784190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.784354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.784584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.784836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.785867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.786912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.787951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.788980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.789138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.789305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.789454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.789599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.789770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.790850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.793169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.793388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.793548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.793724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.793875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.794885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.795058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.795297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.795465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.795622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.795770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.796970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.797977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.798126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.798286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.798458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.798691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.798850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.799941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.800271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.800455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.800605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.800761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.800915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.801893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.802999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.803159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.803394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.803553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.803702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.803849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.804889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.805907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.806952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.807979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.808133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.808343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.808501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.808833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.808998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.809749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.810043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.810357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.810520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.810683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.810831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.811898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.812850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.813858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.814903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.815148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.815310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.815483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.815711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.815863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.816883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.817817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.818046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.818198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.818353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.818509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.818665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.819504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.819670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.819826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.819982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.820157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.820475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.820634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.820782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.820928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.821987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.822904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.823745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.824878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.825975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.826894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.827979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.828232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.828408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.828585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.829418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.829589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.829589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.829589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.830077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.830223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.830665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.830836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.831925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.832074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.832074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.832427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.832595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.832851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.833014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.833165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.833165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.833471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.834266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.834426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.834897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.835050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.835207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.835456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.835626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.835776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.836989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.837908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.838973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.839990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.840145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.840333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.840500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.840734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.840998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.841153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.841300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.841446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.841681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.841938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.842349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.842515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.842515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.842816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.842816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.843905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.844994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.845911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.846993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.847944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.848796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.849983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.850879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.851948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.852977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.853944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.854917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.855968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.856980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.857937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.858916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.859925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.860951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.861843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.862943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.863906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.864877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.865974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.866068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.866372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.866481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.866630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.866722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.867980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.868258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.868385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.868603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.868690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.868917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.869001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.869241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.869590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.869902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.870998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.871938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.872185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.872282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.872572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.872663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.872916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.873265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.873582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.873958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.874111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.874193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.874936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.875825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.876088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.876179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.876482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.876637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.876835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.877138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.877566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.877656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.877884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.877974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.878935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.879895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.880894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.881880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.882797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.883915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.884959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.885847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.886964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.887962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.888917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.889879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.890978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.891979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.892077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.892407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.892617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.892709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.893907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.894956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.895895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.896875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.897808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.898992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.899972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.900945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.901947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.902829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.903989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.904089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.904376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.904482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.904576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:48:53.904667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.904926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.905237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.905548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.905863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.906209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.906530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.906854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.907174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.907495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.908010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.908614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.908983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.909302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.909628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.909973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.910293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.910605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.911048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.911370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.911693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.912017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.912352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.912684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.913042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.913355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.913678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.913987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.914325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.914670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.915002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.915329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.915637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.915943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.916238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.916576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.917038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.917205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.917512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.917820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.918128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.918431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.918737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.919044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.919347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.919640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.919942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.920245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.920587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.920896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.921202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.921505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.921815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.922118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.922426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.922731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.923035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.923338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.924479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.924839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.925165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.925496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.925815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.926145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.926462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.926789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.927186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.927437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.927749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.928089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.928435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.928751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.929064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.929376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.929687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.929999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.930336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.930664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.930972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.931311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.931631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.931955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.932274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.932616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.932951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.933265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.933578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.933896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.934204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.934517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.934839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.935159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.935495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.935829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.936144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.936575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.936914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.937282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.937599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.937956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.938291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.938610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.938923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.939346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:48:53.940254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:48:54.057713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO dbcounter [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Registered counter for database nova_api Jul 11 15:48:54.077743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.085285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writer thread running {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.099159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Registered counter for database nova_api Jul 11 15:48:54.119525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.127529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.141563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.context [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39cfca4d-45cc-4bb7-beae-846c4ae6fa69(cell1) {{(pid=124242) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 15:48:54.145673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:48:54.147275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:48:54.148037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:48:54.150039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:48:54.152011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO dbcounter [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Registered counter for database nova_cell0 Jul 11 15:48:54.155992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO dbcounter [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Registered counter for database nova_cell1 Jul 11 15:48:54.163572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.164978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.171775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writer thread running {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.173345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writer thread running {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.185314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.context [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39cfca4d-45cc-4bb7-beae-846c4ae6fa69(cell1) {{(pid=124241) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 15:48:54.189861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:48:54.191495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:48:54.192319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:48:54.194298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:48:54.196324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Registered counter for database nova_cell0 Jul 11 15:48:54.200403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Registered counter for database nova_cell1 Jul 11 15:48:54.207699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.210735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.215534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.218041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.318182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO dbcounter [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Registered counter for database nova_cell0 Jul 11 15:48:54.327886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_db.sqlalchemy.engines [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.333205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writer thread running {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.367555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Registered counter for database nova_cell0 Jul 11 15:48:54.378296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:48:54.383121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:48:54.652578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:48:54.660591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:48:54.709380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:48:54.717138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:48:55.007171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:48:55.013933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: WARNING keystonemiddleware.auth_token [None req-fc244650-defd-4851-b8f8-7353ea7642a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:48:55.019535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc97e3c9c0 pid: 124242 (default app) Jul 11 15:48:55.070804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 15:48:55.076840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-72f4bddd-8ede-427a-bb99-9e5557ab7537 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 15:48:55.082769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc97e3c9c0 pid: 124241 (default app) Jul 11 15:49:35.240660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.241454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.242173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.242883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.066850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.069335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.070062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.072005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.725163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90eb0600-b5a5-44fd-be62-782c5338c71c tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Action: 'create', calling method: .version_select at 0x7f20b93d05e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1542931214", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90eb0600-b5a5-44fd-be62-782c5338c71c tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 122 Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:36.747814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1542931214", "metadata": {"Type": "work"}}} Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:36.749367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1542931214', 'metadata': {'Type': 'work'}}}} Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise error Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi '#$%' Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:36.750174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 15:49:36.751603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 15:49:36.755080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 15:49:36.755080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.757851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90eb0600-b5a5-44fd-be62-782c5338c71c tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:36.759298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-90eb0600-b5a5-44fd-be62-782c5338c71c tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.536150 Jul 11 15:49:36.760632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 15:49:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1539 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 15:49:36.771657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c822b79e-727a-4ffb-930c-70c8891438f4 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Action: 'create', calling method: .version_select at 0x7f20b9356940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-25067870", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c822b79e-727a-4ffb-930c-70c8891438f4 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 118 Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:36.776729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-25067870", "metadata": {"Type": "work"}}} Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:36.778159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-25067870', 'metadata': {'Type': 'work'}}}} Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise error Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi '0' Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:36.778937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 15:49:36.780189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 15:49:36.782636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 15:49:36.782636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.783982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c822b79e-727a-4ffb-930c-70c8891438f4 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:36.785989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c822b79e-727a-4ffb-930c-70c8891438f4 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018770 Jul 11 15:49:36.787577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 15:49:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 15:49:36.798923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9934b85-8bcf-47e7-bc47-fe1dbfe54db9 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Action: 'create', calling method: .version_select at 0x7f20b93d0820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-760635744", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9934b85-8bcf-47e7-bc47-fe1dbfe54db9 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 118 Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:36.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-760635744", "metadata": {"Type": "work"}}} Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:36.803363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-760635744', 'metadata': {'Type': 'work'}}}} Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise error Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi '' Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:36.804112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 15:49:36.805478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 15:49:36.806595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 15:49:36.806595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:36.808670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9934b85-8bcf-47e7-bc47-fe1dbfe54db9 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:36.809739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c9934b85-8bcf-47e7-bc47-fe1dbfe54db9 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016365 Jul 11 15:49:36.816221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 15:49:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 15:49:36.822820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b27febb1-2f90-4bd1-b9fa-243adad42196 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Calling method '.version_select at 0x7f20b92fb700>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:37.151641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1053980f-1bb2-4360-ab8e-e8f284bebd07 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Action: 'create', calling method: .version_select at 0x7f20b93cf700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1318238005"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:37.885337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-b27febb1-2f90-4bd1-b9fa-243adad42196 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] HTTP exception thrown: Volume tempest-invalid-1212315594 could not be found. Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b27febb1-2f90-4bd1-b9fa-243adad42196 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1212315594 HTTP/1.1 Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:37.890167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Volume tempest-invalid-1212315594 could not be found. Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'tempest-invalid-1212315594'} Jul 11 15:49:37.891719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1212315594 could not be found. (HTTP 404) (Request-ID: req-0198bb7a-512d-486c-96fd-c3a99e3b9445) Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:37.892691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:37.894059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1212315594 could not be found. Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:37.895419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1212315594 could not be found. Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1212315594 could not be found. Jul 11 15:49:37.896897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:37.899953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b27febb1-2f90-4bd1-b9fa-243adad42196 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 404 to user: Volume tempest-invalid-1212315594 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:37.912451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b27febb1-2f90-4bd1-b9fa-243adad42196 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1212315594" status: 404 len: 99 microversion: 2.1 time: 1.088253 Jul 11 15:49:37.912451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 11 15:49:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1212315594 => generated 99 bytes in 1089 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 11 15:49:37.924947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-557eefda-1635-4d54-9384-24206ed649fd tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012178 Jul 11 15:49:37.925791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 11 15:49:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 15:49:37.935880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d529f02c-e6a0-4517-a57b-d0c9261da625 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005034 Jul 11 15:49:37.938009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1136 bytes} [Mon Jul 11 15:49:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 11 15:49:37.958168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97624fc5-e27d-4b69-8b0e-5e180eabe2dc tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Calling method '.version_select at 0x7f20b92299d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:38.274221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-97624fc5-e27d-4b69-8b0e-5e180eabe2dc tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] HTTP exception thrown: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97624fc5-e27d-4b69-8b0e-5e180eabe2dc tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/os-volumes/0bee7382-1848-4658-ac1c-3cfe4565de7d HTTP/1.1 Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:38.276545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '0bee7382-1848-4658-ac1c-3cfe4565de7d'} Jul 11 15:49:38.277876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. (HTTP 404) (Request-ID: req-97cfee6a-432a-4ee4-be3b-fbb493c701d6) Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.278655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:38.279713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 15:49:38.283666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97624fc5-e27d-4b69-8b0e-5e180eabe2dc tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 404 to user: Volume 0bee7382-1848-4658-ac1c-3cfe4565de7d could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97624fc5-e27d-4b69-8b0e-5e180eabe2dc tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0bee7382-1848-4658-ac1c-3cfe4565de7d" status: 404 len: 109 microversion: 2.1 time: 0.332950 Jul 11 15:49:38.287038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 7/7] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:49:37 2022] DELETE /compute/v2.1/os-volumes/0bee7382-1848-4658-ac1c-3cfe4565de7d => generated 109 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 15:49:38.289502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e03c5e3d-8528-496d-af28-83d8eeb2dc35 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Calling method '.version_select at 0x7f20b9229e50>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:38.464016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-e03c5e3d-8528-496d-af28-83d8eeb2dc35 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] HTTP exception thrown: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e03c5e3d-8528-496d-af28-83d8eeb2dc35 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Request method failure captured: Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/os-volumes/b98ef658-ab36-444a-bb9e-29d4e2f11e45 HTTP/1.1 Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPLhA6HDjaGD4UzlCYsEbQUZ_LT-So9OgLUHPF85dyTxaMCkbv7I0fAztde1kqvaTquhdH7IGY2i8qQRhEUT6eppqdbItLl8eZRY_HQhUudDSoDyI4HN5olsmz2ateGDCpDKpvLFic9zcIKRwugPghqQL6jPfTgJ4eFfxcVz7u2Sc Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:38.466130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9722fc206784e65880628276076ac7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9722fc206784e65880628276076ac7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9722fc206784e65880628276076ac7a"}]}] Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: a9722fc206784e65880628276076ac7a Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesNegativeTest-303393218 Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 965e3434001a4b8ab02020e1b9133691 Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesNegativeTest-303393218-project Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'b98ef658-ab36-444a-bb9e-29d4e2f11e45'} Jul 11 15:49:38.467684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. (HTTP 404) (Request-ID: req-849a56bb-3929-4deb-af4b-410b2b24310c) Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.477665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:38.479340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 15:49:38.483717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e03c5e3d-8528-496d-af28-83d8eeb2dc35 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] Returning 404 to user: Volume b98ef658-ab36-444a-bb9e-29d4e2f11e45 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e03c5e3d-8528-496d-af28-83d8eeb2dc35 tempest-VolumesNegativeTest-303393218 tempest-VolumesNegativeTest-303393218-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b98ef658-ab36-444a-bb9e-29d4e2f11e45" status: 404 len: 109 microversion: 2.1 time: 0.182373 Jul 11 15:49:38.486238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 8/8] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:38 2022] GET /compute/v2.1/os-volumes/b98ef658-ab36-444a-bb9e-29d4e2f11e45 => generated 109 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 15:49:39.454504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1053980f-1bb2-4360-ab8e-e8f284bebd07 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.396462 Jul 11 15:49:39.456322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1/9] 10.222.0.26 () {60 vars in 1154 bytes} [Mon Jul 11 15:49:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 15:49:39.469187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-780a67dd-e27f-4bf7-8b0d-4959135aa103 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9229b80>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:39.621074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-780a67dd-e27f-4bf7-8b0d-4959135aa103 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 200 len: 345 microversion: 2.1 time: 0.157404 Jul 11 15:49:39.621637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 9/10] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:39 2022] GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:40.634192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-595cc7d0-d56e-46a0-9449-983cc33be35a tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9296550>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:40.773263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-595cc7d0-d56e-46a0-9449-983cc33be35a tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 200 len: 346 microversion: 2.1 time: 0.141801 Jul 11 15:49:40.781915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 2/11] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:40 2022] GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:40.793343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6cf452a8-0343-4cdb-80bb-02f7a3d95507 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Action: 'create', calling method: .version_select at 0x7f20b9229040>, body: {"snapshot": {"volume_id": "6f4a62de-4f82-43d7-9309-e5e4553f4bba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1039148169"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:41.434272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6cf452a8-0343-4cdb-80bb-02f7a3d95507 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.644547 Jul 11 15:49:41.435151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 10/12] 10.222.0.26 () {60 vars in 1161 bytes} [Mon Jul 11 15:49:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:49:41.445052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d3542cf-624f-4fd3-b9cf-3ba4ee8b347a tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9296670>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:41.532079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d3542cf-624f-4fd3-b9cf-3ba4ee8b347a tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 287 microversion: 2.1 time: 0.090717 Jul 11 15:49:41.535714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 3/13] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:41 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:41.545942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29671cf7-cc00-45c5-a4eb-fdc0b3a949b0 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9356dc0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:41.727305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29671cf7-cc00-45c5-a4eb-fdc0b3a949b0 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.185367 Jul 11 15:49:41.728024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 11 15:49:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:41.746608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e169e9f6-5c36-4dd6-96cc-8f39acbfaf25 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9296d30>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:41.841255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e169e9f6-5c36-4dd6-96cc-8f39acbfaf25 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 287 microversion: 2.1 time: 0.104099 Jul 11 15:49:41.848948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 4/15] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:41 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:42.854255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-faee95df-b3c6-42f1-980f-baf81bd20564 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b923ea60>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:42.938152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-faee95df-b3c6-42f1-980f-baf81bd20564 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 287 microversion: 2.1 time: 0.087653 Jul 11 15:49:42.942907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 12/16] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:42 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:43.950751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-04fdcff5-f7f5-4d15-8741-4016f467393f tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b92af430>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:44.330673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-04fdcff5-f7f5-4d15-8741-4016f467393f tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 287 microversion: 2.1 time: 0.384429 Jul 11 15:49:44.331742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 5/17] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:43 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 287 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:45.343207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-94c51484-e580-4142-84d3-140888dc6856 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b92fb1f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:45.405615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-94c51484-e580-4142-84d3-140888dc6856 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 288 microversion: 2.1 time: 0.066379 Jul 11 15:49:45.411814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 13/18] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:45 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:45.418241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-63ef4602-cf4f-4fdb-a3e4-aa5dfae01822 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9296d30>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:45.585001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-63ef4602-cf4f-4fdb-a3e4-aa5dfae01822 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 202 len: 0 microversion: 2.1 time: 0.171442 Jul 11 15:49:45.585718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 6/19] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 11 15:49:45 2022] DELETE /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 15:49:45.594301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3555f7b2-55e6-4b51-a863-0f907201ba71 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b92293a0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:45.661939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3555f7b2-55e6-4b51-a863-0f907201ba71 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 200 len: 287 microversion: 2.1 time: 0.071427 Jul 11 15:49:45.666050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 14/20] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:45 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:46.676089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54dc4725-8b66-44ed-83b3-5ad20490936e tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9296670>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:46.732767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-54dc4725-8b66-44ed-83b3-5ad20490936e tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] HTTP exception thrown: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54dc4725-8b66-44ed-83b3-5ad20490936e tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Request method failure captured: Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 HTTP/1.1 Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEaPbmy4psjK4XgaCUuDyufURUF3atmqeu-LvQ8eY4f8cHizlLNaIeSAJ6XoZyipm8kO3e0lQZ-LxRpCkDkw90ukBXVNZqlJIfGwPFEEQjOJhF1Un4HphWaSqAMTfNdLIt_oZvY764Puoh7W4w8NjaIFXlUsKQDPRYGYwHhuf8UzRmE Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:49:46.737402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83cc4ffd462346bca1d62ba43dfd980e"}]}] Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 0cb58263f8d64508852375306d31ba91 Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'e59fa0da-48fe-4d8d-b806-d58e095f9501'} Jul 11 15:49:46.738356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. (HTTP 404) (Request-ID: req-5f88ac99-8fd2-485d-8f9f-5e471f3fed46) Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.738967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:46.739867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 11 15:49:46.740833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54dc4725-8b66-44ed-83b3-5ad20490936e tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Returning 404 to user: Snapshot e59fa0da-48fe-4d8d-b806-d58e095f9501 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:46.741743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-54dc4725-8b66-44ed-83b3-5ad20490936e tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501" status: 404 len: 111 microversion: 2.1 time: 0.067264 Jul 11 15:49:46.748653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cc71f6ac-aeba-4a16-93b5-8cdc7c4e6628 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9229160>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:46.758034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 15:49:46 2022] GET /compute/v2.1/os-snapshots/e59fa0da-48fe-4d8d-b806-d58e095f9501 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:49:46.898032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cc71f6ac-aeba-4a16-93b5-8cdc7c4e6628 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 202 len: 0 microversion: 2.1 time: 0.153686 Jul 11 15:49:46.906748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77653d59-7942-4958-878e-61bcbab79abe tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b92afe50>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:46.908249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 15/22] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:49:46 2022] DELETE /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:49:47.052179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77653d59-7942-4958-878e-61bcbab79abe tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 200 len: 345 microversion: 2.1 time: 0.149193 Jul 11 15:49:47.052875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 8/23] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:46 2022] GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:48.065676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a00465bc-6bb8-4c6e-82ac-d394c9957605 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9229af0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:48.139282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-a00465bc-6bb8-4c6e-82ac-d394c9957605 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] HTTP exception thrown: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a00465bc-6bb8-4c6e-82ac-d394c9957605 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Request method failure captured: Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba HTTP/1.1 Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPbmy4psjK4XgaCUuDyufURUF3atmqeu-LvQ8eY4f8cHizlLNaIeSAJ6XoZyipm8kO3e0lQZ-LxRpCkDkw90ukBXVNZqlJIfGwPFEEQjOJhF1Un4HphWaSqAMTfNdLIt_oZvY764Puoh7W4w8NjaIFXlUsKQDPRYGYwHhuf8UzRmE Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:48.141296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83cc4ffd462346bca1d62ba43dfd980e"}]}] Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 0cb58263f8d64508852375306d31ba91 Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '6f4a62de-4f82-43d7-9309-e5e4553f4bba'} Jul 11 15:49:48.143049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. (HTTP 404) (Request-ID: req-c5c75465-60e5-403a-9677-39b4c58c1ffe) Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.143817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:48.145153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 15:49:48.146619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a00465bc-6bb8-4c6e-82ac-d394c9957605 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Returning 404 to user: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:48.147692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a00465bc-6bb8-4c6e-82ac-d394c9957605 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 404 len: 109 microversion: 2.1 time: 0.081078 Jul 11 15:49:48.152674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01dbb8a9-1d16-451e-9a6c-5817594f92ee tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b9216550>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:48.156486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 16/24] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:48 2022] GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:49:48.242817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-01dbb8a9-1d16-451e-9a6c-5817594f92ee tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] HTTP exception thrown: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01dbb8a9-1d16-451e-9a6c-5817594f92ee tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Request method failure captured: Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba HTTP/1.1 Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEaPbmy4psjK4XgaCUuDyufURUF3atmqeu-LvQ8eY4f8cHizlLNaIeSAJ6XoZyipm8kO3e0lQZ-LxRpCkDkw90ukBXVNZqlJIfGwPFEEQjOJhF1Un4HphWaSqAMTfNdLIt_oZvY764Puoh7W4w8NjaIFXlUsKQDPRYGYwHhuf8UzRmE Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:49:48.246502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83cc4ffd462346bca1d62ba43dfd980e"}]}] Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 0cb58263f8d64508852375306d31ba91 Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '6f4a62de-4f82-43d7-9309-e5e4553f4bba'} Jul 11 15:49:48.247562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. (HTTP 404) (Request-ID: req-04546072-fa47-44c1-84a3-a1826d6962d6) Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.248460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 15:49:48.249389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 15:49:48.250421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01dbb8a9-1d16-451e-9a6c-5817594f92ee tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Returning 404 to user: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-01dbb8a9-1d16-451e-9a6c-5817594f92ee tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 404 len: 109 microversion: 2.1 time: 0.099220 Jul 11 15:49:48.254006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 9/25] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:49:48 2022] DELETE /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:49:48.275227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0248a926-a485-41ec-9515-223fbed172d9 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Calling method '.version_select at 0x7f20b92299d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:48.808122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-0248a926-a485-41ec-9515-223fbed172d9 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] HTTP exception thrown: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0248a926-a485-41ec-9515-223fbed172d9 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Request method failure captured: Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba HTTP/1.1 Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEaPbmy4psjK4XgaCUuDyufURUF3atmqeu-LvQ8eY4f8cHizlLNaIeSAJ6XoZyipm8kO3e0lQZ-LxRpCkDkw90ukBXVNZqlJIfGwPFEEQjOJhF1Un4HphWaSqAMTfNdLIt_oZvY764Puoh7W4w8NjaIFXlUsKQDPRYGYwHhuf8UzRmE Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:49:48.810511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83cc4ffd462346bca1d62ba43dfd980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83cc4ffd462346bca1d62ba43dfd980e"}]}] Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 83cc4ffd462346bca1d62ba43dfd980e Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441297719 Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 0cb58263f8d64508852375306d31ba91 Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441297719-project Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '6f4a62de-4f82-43d7-9309-e5e4553f4bba'} Jul 11 15:49:48.812872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. (HTTP 404) (Request-ID: req-5f5ef5bb-e08b-4728-a80f-1d1a0a9b44ec) Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.813776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:49:48.814961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 15:49:48.816014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0248a926-a485-41ec-9515-223fbed172d9 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] Returning 404 to user: Volume 6f4a62de-4f82-43d7-9309-e5e4553f4bba could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:49:48.817555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0248a926-a485-41ec-9515-223fbed172d9 tempest-VolumesSnapshotsTestJSON-441297719 tempest-VolumesSnapshotsTestJSON-441297719-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba" status: 404 len: 109 microversion: 2.1 time: 0.541945 Jul 11 15:49:48.825719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 17/26] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:48 2022] GET /compute/v2.1/os-volumes/6f4a62de-4f82-43d7-9309-e5e4553f4bba => generated 109 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 15:49:50.179505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fff5030c-80eb-45b1-8ca7-242ecd6ef638 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'create', calling method: .version_select at 0x7f20b92afc10>, body: {"keypair": {"name": "tempest-keypair-1879361323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDCFekTOqcEyxctgr5QEC9pQZTW3hyYY5xasHhRE0D/mxVFvKpGpbiVSt8T8UUpawJKA9T1Q6YD2MTZlgaGx2d/nrb56YOQDboFOBzUrycZpyhC9l2Utrjr3LGs5nBqpA=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:50.307576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-fff5030c-80eb-45b1-8ca7-242ecd6ef638 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:49:50.322504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-fff5030c-80eb-45b1-8ca7-242ecd6ef638 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for user 052b95d2857c4e728a8008d00fc34780 and project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:49:50.418847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fff5030c-80eb-45b1-8ca7-242ecd6ef638 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.903152 Jul 11 15:49:50.419725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 10/27] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 15:49:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:52.501976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-924505179", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "networks": [{"uuid": "4f76ac2a-28ca-4437-b882-c026ca8add63"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:52.713440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] validate_networks() for [('4f76ac2a-28ca-4437-b882-c026ca8add63', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:49:54.117248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-515893884", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:54.406346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] validate_networks() for [('f70e4607-6877-45c5-bd0c-dc82275e0108', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:49:56.383882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:49:56.384433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:49:56.384691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:49:56.385093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:49:56.385499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:49:56.417594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:56.418940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:56.421071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:56.424766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:56.496409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Getting quotas for project bf151ebb2425421d8cdc3e2773fbd558. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:49:56.527571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Getting quotas for user c0e395655fb14e3b92ed88eb3ea231db and project bf151ebb2425421d8cdc3e2773fbd558. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:49:56.560641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:49:56.566642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:49:56.780796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e7104257-7bb1-4931-8dfb-b9bbba844307 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.887100 Jul 11 15:49:56.781498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 18/28] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:49:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:49:56.988517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:49:56.990358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:49:56.990872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:49:56.991423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:49:56.991841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:49:57.014836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:57.015308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:57.019221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:57.021305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:57.089378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:49:57.101099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for user 9d44f1f434534cc0b373943d48d672df and project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:49:57.135640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:49:57.139157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:49:57.280416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8479ce7c-5438-4f43-a576-c3f553f4faaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.923664 Jul 11 15:49:57.284370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 11/29] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:49:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:49:57.295867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2103681540", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19ffd085-49b4-45aa-95c3-202792f9f19a"}], "security_groups": [{"name": "tempest-securitygroup--1028037085"}], "key_name": "tempest-keypair-1879361323", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:57.445766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af8140ba-85a7-4e70-87c1-bdfe0235f291 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Action: 'create', calling method: .version_select at 0x7f20b91291f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2102002049", "metadata": {"Type": "work"}}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:57.552518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] validate_networks() for [('19ffd085-49b4-45aa-95c3-202792f9f19a', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:49:58.138151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af8140ba-85a7-4e70-87c1-bdfe0235f291 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.355069 Jul 11 15:49:58.139559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 19/30] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 15:49:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1357 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 15:49:58.150360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-24493163-fd0b-46bb-96ec-0ae94dca87a3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:58.151283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-24493163-fd0b-46bb-96ec-0ae94dca87a3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:49:58.474326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-24493163-fd0b-46bb-96ec-0ae94dca87a3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:49:58.505309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-24493163-fd0b-46bb-96ec-0ae94dca87a3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1214 microversion: 2.1 time: 0.364090 Jul 11 15:49:58.505933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 20/31] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:49:58 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:49:58.529430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eb46dafd-960f-4440-9d6b-a9b39aef7afe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:58.530065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eb46dafd-960f-4440-9d6b-a9b39aef7afe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:49:58.803227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eb46dafd-960f-4440-9d6b-a9b39aef7afe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:49:58.814876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eb46dafd-960f-4440-9d6b-a9b39aef7afe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1221 microversion: 2.1 time: 0.307864 Jul 11 15:49:58.815469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 21/32] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:49:58 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1221 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:49:58.829057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f24c06c0-9823-40ea-80e8-6dc9b620c784 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Calling method '.version_select at 0x7f20b80e0af0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:58.877351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:49:58.878008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:49:58.878672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:49:58.879082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:49:58.879488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:49:58.898253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:58.901325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:58.902165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:58.904579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:58.939966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f24c06c0-9823-40ea-80e8-6dc9b620c784 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336" status: 200 len: 354 microversion: 2.1 time: 0.118863 Jul 11 15:49:58.941314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 22/33] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:58 2022] GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:58.956071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-07c17b0f-7600-4230-b8e1-a48ef3d46b04 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Calling method '.version_select at 0x7f20b80c6670>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:58.989352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:49:58.999435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for user 052b95d2857c4e728a8008d00fc34780 and project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:49:59.044673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:49:59.062628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:49:59.064250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-07c17b0f-7600-4230-b8e1-a48ef3d46b04 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336" status: 200 len: 354 microversion: 2.1 time: 0.113862 Jul 11 15:49:59.064950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 23/34] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:58 2022] GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:49:59.079529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-316d658b-b8ba-4b8b-a682-28f4548097df tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Calling method '.version_select at 0x7f20b80f0550>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:59.214462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-525aa1e0-ca2a-4e38-9e33-7835345489a2 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.927924 Jul 11 15:49:59.216739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 12/35] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:49:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:49:59.236223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-316d658b-b8ba-4b8b-a682-28f4548097df tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336" status: 202 len: 0 microversion: 2.1 time: 0.161632 Jul 11 15:49:59.237300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 24/36] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:49:59 2022] DELETE /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 15:49:59.257097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8bffde71-abe5-4005-b701-6f9dcd797748 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Calling method '.version_select at 0x7f20b80c6550>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:59.267806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-445b68f2-1540-40f8-81b7-c92b36f77769 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:59.268863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-445b68f2-1540-40f8-81b7-c92b36f77769 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:49:59.425061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8bffde71-abe5-4005-b701-6f9dcd797748 tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336" status: 200 len: 353 microversion: 2.1 time: 0.180497 Jul 11 15:49:59.426028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 25/37] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:49:59 2022] GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:49:59.503550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-906680939", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:49:59.556858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-445b68f2-1540-40f8-81b7-c92b36f77769 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:49:59.591658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-445b68f2-1540-40f8-81b7-c92b36f77769 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1238 microversion: 2.1 time: 0.352714 Jul 11 15:49:59.598698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 13/38] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:49:59 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1238 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:49:59.616816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:49:59.617462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:49:59.644497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:59.645953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:59.652320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:49:59.655409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:49:59.665993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] validate_networks() for [('f70e4607-6877-45c5-bd0c-dc82275e0108', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:49:59.982712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:00.015657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6beef15a-fe37-46b3-91dd-a1e5db9aac4c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1210 microversion: 2.1 time: 0.411882 Jul 11 15:50:00.018985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 14/39] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:49:59 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1210 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:00.439460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62245651-d49f-4246-a0dc-9c689795d1ba tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Calling method '.version_select at 0x7f20b8089790>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:00.481920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:50:00.482593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:50:00.483698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:50:00.485243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:50:00.486038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:50:00.511585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:00.514076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:00.515572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:00.518077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:00.524960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-62245651-d49f-4246-a0dc-9c689795d1ba tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] HTTP exception thrown: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62245651-d49f-4246-a0dc-9c689795d1ba tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Request method failure captured: Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 HTTP/1.1 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEai3wT7gkYT8PIkrcDeoZ3wE8n7AqxkHWGmNBo3Lb70zpDM7YF2B31VHHQgPkNinLizUa2dcSVJk5WUSYJ4OqOdoxMzd99A7aBmbkCuvTZf-Y3fLH3BmEW-iCg-birbQwkh5mMHIEN7qVxRTI_duhvFgcMfcruq-v2M5211H0t-1UA Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 7e8f045dbf4e4f8a94db9e14af8b4812 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesGetTestJSON-110361292 Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:50:00.528078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e8f045dbf4e4f8a94db9e14af8b4812"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e8f045dbf4e4f8a94db9e14af8b4812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e8f045dbf4e4f8a94db9e14af8b4812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e8f045dbf4e4f8a94db9e14af8b4812"}]}] Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesGetTestJSON-110361292 Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7e8f045dbf4e4f8a94db9e14af8b4812 Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesGetTestJSON-110361292 Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesGetTestJSON-110361292-project Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 75bbe584451748bd8e2db06b1dab7a52 Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesGetTestJSON-110361292-project Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '0078d90d-28c8-420b-a34d-a1b9ab27c336'} Jul 11 15:50:00.529227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. (HTTP 404) (Request-ID: req-0e2d9f9b-d43e-4afb-9fd3-7de2323d15b3) Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:50:00.529880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 15:50:00.530781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 15:50:00.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. Jul 11 15:50:00.533373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:50:00.535848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62245651-d49f-4246-a0dc-9c689795d1ba tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] Returning 404 to user: Volume 0078d90d-28c8-420b-a34d-a1b9ab27c336 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:50:00.536994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62245651-d49f-4246-a0dc-9c689795d1ba tempest-VolumesGetTestJSON-110361292 tempest-VolumesGetTestJSON-110361292-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336" status: 404 len: 109 microversion: 2.1 time: 0.102427 Jul 11 15:50:00.538064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 15/40] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:50:00 2022] GET /compute/v2.1/os-volumes/0078d90d-28c8-420b-a34d-a1b9ab27c336 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:50:00.613185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:50:00.615420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:00.616046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:00.622582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for user 9d44f1f434534cc0b373943d48d672df and project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:50:00.631922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:00.633011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:00.637798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:00.638924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:00.682093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:50:00.691100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:50:00.825536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-582472d4-52e1-49e5-94d1-7028563ef289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.326602 Jul 11 15:50:00.826801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 26/41] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:49:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:50:00.839477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3829c2e8-f742-4c42-9096-d92ed7ca9ff2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:00.841062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3829c2e8-f742-4c42-9096-d92ed7ca9ff2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:01.121789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:01.135346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb187b38-4809-4ce3-a673-dcf7ca498e43 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1234 microversion: 2.1 time: 0.523576 Jul 11 15:50:01.138373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 16/42] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:00 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1234 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:01.144494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:01.145292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:01.152466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3829c2e8-f742-4c42-9096-d92ed7ca9ff2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:01.164152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3829c2e8-f742-4c42-9096-d92ed7ca9ff2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1221 microversion: 2.1 time: 0.331152 Jul 11 15:50:01.168216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 27/43] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:00 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1221 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:01.178367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:01.179074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:01.181163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:01.181976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:01.422624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:01.432467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4f7b4fe-ae3c-41f8-aea2-2f96f28cc635 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1272 microversion: 2.1 time: 0.292837 Jul 11 15:50:01.446716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 17/44] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:01 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:02.154269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:02.155081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:02.170954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.171405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.184198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:02.184960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:02.195190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.197214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.197852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.201606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.211136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.211431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.432614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:02.449970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3690cd2-17c0-498d-ac47-f311fb5a3107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1273 microversion: 2.1 time: 0.268263 Jul 11 15:50:02.454255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 18/45] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:02 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:02.470812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:02.471885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:02.489395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.491336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.493941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:02.496106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:02.518934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:02.541784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bb2f2ba1-b876-4c53-9fd2-66fe44178ad1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1296 microversion: 2.1 time: 0.390851 Jul 11 15:50:02.543787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 28/46] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:02 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1296 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:02.804648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:02.831537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3bdddb03-a9dd-4558-bf1f-8e1178f439b7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1272 microversion: 2.1 time: 0.370159 Jul 11 15:50:02.832219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 19/47] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:02 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1272 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:03.470381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:03.471940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:03.485761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:03.488712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:03.491978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:03.493282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:03.560933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:03.561745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:03.574126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:03.574595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:03.575380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:03.601532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:04.116957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:04.139885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d5dc5eca-28dd-4508-94bf-5d915f9b7bc1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1296 microversion: 2.1 time: 0.572152 Jul 11 15:50:04.143148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 20/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:03 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1296 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:04.148459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:04.149459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:04.157166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:04.158203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:04.159305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:04.160061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:04.269421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:04.278873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab6e68d8-a8a3-4595-8916-cd8bd7f3527e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1279 microversion: 2.1 time: 0.814120 Jul 11 15:50:04.288528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 29/49] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:03 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1279 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:05.150573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:05.152080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:05.164371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:05.165187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:05.166645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:05.170206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:05.446312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:05.461691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f51beaad-c453-4847-b988-250dd1171e4f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 1.317115 Jul 11 15:50:05.463281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 21/50] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:04 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:05.479073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:05.482066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:05.498113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:05.498781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:05.499793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:05.504686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:05.598892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:05.611043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-72777263-f7bb-4de7-9747-20053f545b5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1296 microversion: 2.1 time: 0.464631 Jul 11 15:50:05.621603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 30/51] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:05 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1296 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:05.784614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:05.804799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78475771-f7fd-4533-9684-92f082b32bbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1279 microversion: 2.1 time: 0.330970 Jul 11 15:50:05.815357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 22/52] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:05 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1279 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:06.478985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:06.479610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:06.496079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:06.496572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:06.497369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:06.497815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:06.628470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:06.629998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:06.650583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:06.653879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:06.655006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:06.658713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:07.305743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:07.314652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2213a537-77b5-4040-9999-062e00686136 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.839470 Jul 11 15:50:07.325914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 31/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:06 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:07.331357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:07.332251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:07.339203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:07.339903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:07.340911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:07.341486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:07.720042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:07.736477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-07e8f666-3a56-4c4a-a2a0-ba3f1481592c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 1.112382 Jul 11 15:50:07.737094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 23/54] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:06 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:07.996462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:08.006338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-82507bc5-ed11-4545-9505-f3172cef2619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.678977 Jul 11 15:50:08.009607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 32/55] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:07 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:08.334877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:08.336063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:08.348707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:08.349440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:08.351114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:08.351764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:08.764865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:08.765849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:08.810729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:08.823151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:08.826528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:08.829627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:08.929153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:09.573959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=18 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:09.632514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:09.644950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c6391227-29c5-4181-8478-af9b4f88a163 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 1.312050 Jul 11 15:50:09.647561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 24/56] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:08 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:09.667827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:09.669428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:09.691973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:09.693123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:09.695489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:09.697363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.159257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:10.179919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f708a8f-b9bd-4cd0-b6ed-5c7763cbe1eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 1.429225 Jul 11 15:50:10.182484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 33/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:08 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:10.349669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-6ff32e4a-5bdf-43b8-acd9-b3f8250a9d9a req-16d1c6fa-2bea-4623-a769-7877640cfa6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9253b43a-7bea-41c3-9e1a-3e37e78d533b", "tag": "569881a6-8f34-4c5f-8e43-71e7594c6f67"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:10.382840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6ff32e4a-5bdf-43b8-acd9-b3f8250a9d9a req-16d1c6fa-2bea-4623-a769-7877640cfa6d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:10.383285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6ff32e4a-5bdf-43b8-acd9-b3f8250a9d9a req-16d1c6fa-2bea-4623-a769-7877640cfa6d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.452638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-6ff32e4a-5bdf-43b8-acd9-b3f8250a9d9a req-16d1c6fa-2bea-4623-a769-7877640cfa6d service nova] Creating event network-changed:569881a6-8f34-4c5f-8e43-71e7594c6f67 for instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b on hv-cinder-79760 Jul 11 15:50:10.454540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6ff32e4a-5bdf-43b8-acd9-b3f8250a9d9a req-16d1c6fa-2bea-4623-a769-7877640cfa6d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 15:50:10.458893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:10.459857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.461172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:10.461753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.477737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.compute.rpcapi [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 15:50:10.479523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] Releasing lock "compute-rpcapi-router" {{(pid=124242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 15:50:10.545474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d133de82-1edf-4cda-bf83-12adaf54386c None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359044 Jul 11 15:50:10.546390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 34/58] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:10.666086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:10.667010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:10.686152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:10.690651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.696193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:10.697751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:10.906374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:10.921701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87d89b62-5f95-48d6-b0df-e1c4b0d0335c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 1.271669 Jul 11 15:50:10.932127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 25/59] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:09 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:11.164068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=18 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:11.341071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-9a252b2d-f9a0-4fe2-b80c-1805167f1bd3 req-b0804ed4-05b4-4579-8e95-daf1065daafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2901472e-529a-4ef6-a35e-0677479d2964", "tag": "248914ee-b4de-4e63-aafa-d5668dd61063"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:11.362752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9a252b2d-f9a0-4fe2-b80c-1805167f1bd3 req-b0804ed4-05b4-4579-8e95-daf1065daafe service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:11.371423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9a252b2d-f9a0-4fe2-b80c-1805167f1bd3 req-b0804ed4-05b4-4579-8e95-daf1065daafe service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:11.414450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-9a252b2d-f9a0-4fe2-b80c-1805167f1bd3 req-b0804ed4-05b4-4579-8e95-daf1065daafe service nova] Creating event network-changed:248914ee-b4de-4e63-aafa-d5668dd61063 for instance 2901472e-529a-4ef6-a35e-0677479d2964 on hv-cinder-79760 Jul 11 15:50:11.416918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9a252b2d-f9a0-4fe2-b80c-1805167f1bd3 req-b0804ed4-05b4-4579-8e95-daf1065daafe service nova] Acquired lock "compute-rpcapi-router" {{(pid=124241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 15:50:11.420970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:11.422602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:11.425900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:11.428275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:11.511759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.compute.rpcapi [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 15:50:11.514973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] Releasing lock "compute-rpcapi-router" {{(pid=124241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 15:50:11.554360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-42ab4ad1-74b2-4541-898c-a177b79e6218 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.518011 Jul 11 15:50:11.556485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 26/60] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:11.572155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:11.574428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:11.593881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:11.594671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:11.595767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:11.597260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:12.216205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:12.227424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d9703b1c-ad15-4d47-9240-736209d102ac tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 1.565941 Jul 11 15:50:12.240392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 35/61] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:10 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:12.240392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2068f8b-48fe-4d29-b464-05d29ae2e3a7 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3fdcaf0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:12.312214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2068f8b-48fe-4d29-b464-05d29ae2e3a7 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/210a7caa-8d34-4072-9a82-9c4bd10b5c52" status: 200 len: 350 microversion: 2.1 time: 0.078503 Jul 11 15:50:12.313826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 36/62] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:50:12 2022] GET /compute/v2.1/os-volumes/210a7caa-8d34-4072-9a82-9c4bd10b5c52 => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:12.338134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:12.338771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:12.376820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:12.377305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:12.378112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:12.382340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:12.456072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:12.465003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-157ad2ca-62c6-4f85-826c-3fb83d79e470 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.906777 Jul 11 15:50:12.466907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 27/63] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:11 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:12.629800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-1ab1409a-a717-43c8-a0e3-c9f34a3287f1 req-e501a088-0e21-4b4e-8213-6f21e1b5c405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b13d806-c073-41ec-8b74-f0dfc037fa88", "tag": "bbde3788-fd0a-43b7-805f-a658829f18d7"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:12.643029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-1ab1409a-a717-43c8-a0e3-c9f34a3287f1 req-e501a088-0e21-4b4e-8213-6f21e1b5c405 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:12.643710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-1ab1409a-a717-43c8-a0e3-c9f34a3287f1 req-e501a088-0e21-4b4e-8213-6f21e1b5c405 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:12.673951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-1ab1409a-a717-43c8-a0e3-c9f34a3287f1 req-e501a088-0e21-4b4e-8213-6f21e1b5c405 service nova] Creating event network-changed:bbde3788-fd0a-43b7-805f-a658829f18d7 for instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 on hv-cinder-79760 Jul 11 15:50:12.682889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-1ab1409a-a717-43c8-a0e3-c9f34a3287f1 req-e501a088-0e21-4b4e-8213-6f21e1b5c405 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058343 Jul 11 15:50:12.684190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 28/64] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:12.705371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:12.716158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f2b8996d-d4a2-4b1a-a175-eeac3303d613 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.389935 Jul 11 15:50:12.717360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 37/65] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:12 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:13.250791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:13.251652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:13.258940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.259382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.260145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.260576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.402649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:13.411332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-426af7fd-db6f-442b-bf10-d4aacb189498 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.166148 Jul 11 15:50:13.412050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 29/66] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:13 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:13.483195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:13.483789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:13.489903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.490352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.491106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.491536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.618170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-375fb485-301e-4c44-bd9b-f371b2a21cb6 req-0f882bc1-b097-4cf9-836b-fa8a076b6953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5a5cc5-eb58-4a02-8306-33f472159b67", "tag": "100ec958-8a68-4db9-9f51-e4e889c6ddce"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:13.623717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:13.627061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-375fb485-301e-4c44-bd9b-f371b2a21cb6 req-0f882bc1-b097-4cf9-836b-fa8a076b6953 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.627493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-375fb485-301e-4c44-bd9b-f371b2a21cb6 req-0f882bc1-b097-4cf9-836b-fa8a076b6953 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.632700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-12255013-dcd0-452d-a609-1adc67af4da4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.153375 Jul 11 15:50:13.633345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 38/67] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:13 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:13.646069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-375fb485-301e-4c44-bd9b-f371b2a21cb6 req-0f882bc1-b097-4cf9-836b-fa8a076b6953 service nova] Creating event network-changed:100ec958-8a68-4db9-9f51-e4e889c6ddce for instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 on hv-cinder-79760 Jul 11 15:50:13.650929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-375fb485-301e-4c44-bd9b-f371b2a21cb6 req-0f882bc1-b097-4cf9-836b-fa8a076b6953 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036395 Jul 11 15:50:13.651595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 30/68] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:13.736375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:13.737073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:13.743167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.743603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.744413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:13.744841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:13.893017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:13.900663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d3bdd626-163b-4e7b-a875-a299984f8c4e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.168320 Jul 11 15:50:13.901231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 39/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:13 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:14.431581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:14.432270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:14.439850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.440350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.441131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.441558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.584939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:14.593997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7fd4b076-fca5-4dc1-88dd-3d3a5f9d4d88 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.167451 Jul 11 15:50:14.594664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 31/70] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:14 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:14.652955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:14.653661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:14.662288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.662944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.664110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.664810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.804883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:14.814117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f6f05a84-8111-40ac-ac05-6a221a5297b0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.167389 Jul 11 15:50:14.814755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 40/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:14 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:14.919205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:14.919813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:14.932387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.932849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.933657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:14.934757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:14.961966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:15.093692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:15.102417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84251643-6995-4763-ab89-74ef2c5252af tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.188010 Jul 11 15:50:15.103084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 32/72] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:14 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:15.611869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:15.612789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:15.615681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:15.627063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:15.627847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:15.628908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:15.629553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:15.820093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:15.832966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:15.834766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:15.845684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63f69b14-21a6-4b17-9ba5-4f0f02779649 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.235400 Jul 11 15:50:15.850170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 41/73] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:15 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:15.850382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:15.851031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:15.852125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:15.852812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:16.059120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7412cd8-272e-4e09-87b3-2ef9646beeea tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3f531f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:16.171835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7412cd8-272e-4e09-87b3-2ef9646beeea tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/694135ac-f60b-4a9a-a907-3301338c0f30" status: 200 len: 350 microversion: 2.1 time: 0.116508 Jul 11 15:50:16.173279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 42/74] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:50:16 2022] GET /compute/v2.1/os-volumes/694135ac-f60b-4a9a-a907-3301338c0f30 => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:50:16.179696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:16.181575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:16.198743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:16.201144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:16.206326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:16.207571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:16.212948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:16.228742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0bb162d-e1d4-452a-b280-2e7209304ef4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.401308 Jul 11 15:50:16.238213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 33/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:15 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:16.467959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:16.480656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8aa33445-ed75-4786-b3ce-abec346ebb84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.305497 Jul 11 15:50:16.482228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 43/76] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:16 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:16.867385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:16.868226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:16.870253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:16.892689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:16.893624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:16.895969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:16.896400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:17.246098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:17.246857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:17.255017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:17.266310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:17.269269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:17.279363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:17.412204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:17.436177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b34743a3-b263-4b7f-bf6c-dc0c9bfad187 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.571599 Jul 11 15:50:17.457227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 34/77] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:16 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:17.501295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:17.502146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:17.514737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:17.517047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:17.520488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:17.522234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:17.795304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:17.803335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f29f707-43d6-4f9e-aa38-9a204ce6df13 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.561227 Jul 11 15:50:17.804088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 44/78] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:17 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:17.811402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37645939-38f4-4bad-90c0-9391a63c1b22 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b8068ca0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:17.811712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:17.820351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5f44a5b-cbb9-4175-83ab-a5939e555f79 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.324921 Jul 11 15:50:17.821092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 35/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:17 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:17.860159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37645939-38f4-4bad-90c0-9391a63c1b22 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b9dc1bc-ba58-4289-a678-0a9af5223395" status: 200 len: 351 microversion: 2.1 time: 0.054708 Jul 11 15:50:17.860793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 45/80] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 15:50:17 2022] GET /compute/v2.1/os-volumes/2b9dc1bc-ba58-4289-a678-0a9af5223395 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:17.873195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-704d8d56-c8e8-4787-bd2b-60dcb248b696 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b37630d0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:17.953645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-704d8d56-c8e8-4787-bd2b-60dcb248b696 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084714 Jul 11 15:50:17.954373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 36/81] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 11 15:50:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:17.967815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f37f2de1-614b-4f20-a1bd-e367bbb4c9a4 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3fdc310>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.053016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f37f2de1-614b-4f20-a1bd-e367bbb4c9a4 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089599 Jul 11 15:50:18.053594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 46/82] 10.222.0.26 () {58 vars in 1148 bytes} [Mon Jul 11 15:50:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:18.067371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff19f0d4-d9f0-46ea-929d-7675bc24b1d3 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b370a550>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.145878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff19f0d4-d9f0-46ea-929d-7675bc24b1d3 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082225 Jul 11 15:50:18.146456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 37/83] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:18.160486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a5c2993-a700-42a6-a2de-96797812db24 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3ff51f0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.242154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a5c2993-a700-42a6-a2de-96797812db24 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085789 Jul 11 15:50:18.242740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 47/84] 10.222.0.26 () {58 vars in 1166 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:18.255066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-897181b1-ce0c-49a7-8e0d-ce57739e7963 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b37d1a60>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.337547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-897181b1-ce0c-49a7-8e0d-ce57739e7963 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086142 Jul 11 15:50:18.338090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 38/85] 10.222.0.26 () {58 vars in 1169 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:18.349972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a96fcd02-0e4e-4882-b14c-33e35337fd45 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3f53dc0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.441992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a96fcd02-0e4e-4882-b14c-33e35337fd45 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095660 Jul 11 15:50:18.442576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 48/86] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:18.454693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56b94d76-0b83-4b8e-90d5-afc1a928ee66 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b3797af0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.473587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.474352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:18.481299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.482244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:18.483008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.483441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:18.546579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56b94d76-0b83-4b8e-90d5-afc1a928ee66 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095529 Jul 11 15:50:18.547800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 39/87] 10.222.0.26 () {58 vars in 1187 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:18.558955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49ff8223-f5b4-4a07-830d-f03b46ad2b39 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] Calling method '.version_select at 0x7f20b370a670>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.626837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:18.636952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c5b3752-9ea6-4616-8836-c9b282aaecf9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.167527 Jul 11 15:50:18.637675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 49/88] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:18.646258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49ff8223-f5b4-4a07-830d-f03b46ad2b39 tempest-VolumesTestJSON-1757166475 tempest-VolumesTestJSON-1757166475-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091126 Jul 11 15:50:18.646942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 40/89] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:18.820514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.821128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:18.827191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.827718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:18.828532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.828957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:18.832872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:18.838303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:18.838927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:18.846008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.846468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:18.847637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:18.847796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:19.014592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:19.022766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fbd4c81-9bf1-4718-9fd1-d7acd5a63163 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.206097 Jul 11 15:50:19.023367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 50/90] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:19.038703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:19.046625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d8a99ce-9f55-4328-bde4-d5387d6610a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.213451 Jul 11 15:50:19.047241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 41/91] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:18 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:19.663567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:19.664709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:19.674890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:19.675623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:19.676891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:19.677597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:19.833150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:19.840977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ae05f8c-758b-4e3a-ab0b-d5374dd3118b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.183901 Jul 11 15:50:19.841536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 51/92] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:19 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:20.045253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:20.046423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:20.052832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.053270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:20.054011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.054437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:20.069593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:20.070206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:20.076972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.077447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:20.078688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.079128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:20.270998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:20.278562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f2af8d21-4b0d-4de0-bf1d-0620b09507f6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.239963 Jul 11 15:50:20.279238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 42/93] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:20 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:20.293424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:20.302686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e96ffd9-3955-45ba-93a1-3cbb3e0d99cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.236889 Jul 11 15:50:20.303211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 52/94] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:20 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:20.857796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:20.858414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:20.867809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.868241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:20.869028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:20.870808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:21.057979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:21.067411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-439329fc-5266-403f-8761-b76aebc0bb3e tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.213392 Jul 11 15:50:21.068302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:20 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:21.293546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:21.298878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:21.299923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:21.307972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:21.308513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:21.310455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:21.311048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:21.323722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:21.324402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:21.334579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:21.335840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:21.340367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:21.340367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:21.492455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:21.548757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:21.562305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd430ced-8285-46fa-acb8-443edb56f9d6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.269402 Jul 11 15:50:21.565039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 53/96] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:21 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:21.591480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:21.604824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c3ca138d-ae9e-4a44-bc92-21632c60e554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.285425 Jul 11 15:50:21.608436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 44/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:21 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:22.088028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:22.089183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:22.097626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.098097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.098858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.099247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.264641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:22.274970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-effe7d82-f6b1-4069-a8e1-8023effb35fb tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.193516 Jul 11 15:50:22.275516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 54/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:22 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:22.583701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:22.585429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:22.592217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.592733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.593606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.594035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.626746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:22.627364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:22.634541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.635124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.635965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:22.636658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:22.785879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:22.793523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-140916eb-1526-4d28-a086-cd8adc7c19fe tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.214786 Jul 11 15:50:22.794304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:22 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:22.812916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:22.820999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52f341db-3bc5-4393-bbd1-1b34514a2874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.199323 Jul 11 15:50:22.821572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 55/100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:22 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:23.296050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:23.297403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:23.307783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.308595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:23.309844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.310566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:23.456699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:23.464547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05189fe6-51d5-44e9-b53e-7ab9a88149c7 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.174940 Jul 11 15:50:23.465152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 46/101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:23 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:23.809926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:23.810547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:23.816892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.817342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:23.818107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.818537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:23.844991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:23.846050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:23.854244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.854790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:23.855615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:23.856109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:24.108852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:24.112805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:24.117926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a08ab292-4c7f-46d4-b99a-3f948cf6627e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.311964 Jul 11 15:50:24.118513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 56/102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:23 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:24.125613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2006933b-acac-4145-bf5f-f7291ccb8244 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.285015 Jul 11 15:50:24.127077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 47/103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:23 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:24.485219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:24.486289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:24.497402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:24.497975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:24.498876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:24.499550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:24.639095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:24.647597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ad88453-9b17-4337-a4a4-a45c5adfaac0 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.168518 Jul 11 15:50:24.648535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 57/104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:24 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:25.135024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:25.137324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:25.142432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.142851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:25.143314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.143594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.143701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:25.144034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.149887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.150431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.151256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.151839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.372936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:25.381140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b6ff3c1-0da3-4b92-b35d-d46ccae2e6c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.242432 Jul 11 15:50:25.381738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 58/105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:25 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:25.383335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:25.391839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-325a0f88-3de6-4f16-88d8-0eead257681a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.260647 Jul 11 15:50:25.392407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 48/106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:25 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:25.668058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:25.668941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:25.677973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.678565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.679635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:25.680216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:25.814870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:25.825800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17dbfc67-2b56-4a91-9e95-9f326c42086b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.163683 Jul 11 15:50:25.826411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 59/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:25 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:26.398026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:26.398552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:26.404887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.405331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.406402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.406824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.408646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:26.409281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:26.415686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.416141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.417008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.417442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.613144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:26.616715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:26.626188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8897d2d3-7a02-473b-9563-ffa7eb6e2df3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.221493 Jul 11 15:50:26.626999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 60/108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:26 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:26.637344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-329c23ff-d3cb-43d9-9ddf-9f311b6f932d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.243201 Jul 11 15:50:26.644499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 49/109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:26 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:26.843889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:26.844521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:26.851011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.851765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.852547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:26.852973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:26.989061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:26.996561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-952ee55c-dc06-41f2-b322-661014fda0d3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.156932 Jul 11 15:50:26.997132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 61/110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:26 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:27.645756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:27.648840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:27.654053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:27.654818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:27.655417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:27.655878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:27.656680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:27.657110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:27.664432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:27.667392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:27.668394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:27.668900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:28.167975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:28.181241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1106b676-bf61-4082-92ad-eb5d21dd6255 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.539510 Jul 11 15:50:28.189546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 50/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:27 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:28.194504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:28.195331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:28.213123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:28.213571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:28.215545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:28.215545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:28.278457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:28.299280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31595348-c8db-4c61-b3a0-6ed009b33e33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.649374 Jul 11 15:50:28.300190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 62/112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:27 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:28.531121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:28.540534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a71a548-89dc-4719-9575-14cb08764ed9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.349673 Jul 11 15:50:28.550951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 51/113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:28 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:29.035760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-35aeefd9-63c8-4f00-9c83-aa1d0ab7b015 req-27da916d-b1ec-4d71-9910-c51d0c355c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5a5cc5-eb58-4a02-8306-33f472159b67", "name": "network-vif-plugged", "status": "completed", "tag": "100ec958-8a68-4db9-9f51-e4e889c6ddce"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:29.044086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-35aeefd9-63c8-4f00-9c83-aa1d0ab7b015 req-27da916d-b1ec-4d71-9910-c51d0c355c1a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.045175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-35aeefd9-63c8-4f00-9c83-aa1d0ab7b015 req-27da916d-b1ec-4d71-9910-c51d0c355c1a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.056887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-35aeefd9-63c8-4f00-9c83-aa1d0ab7b015 req-27da916d-b1ec-4d71-9910-c51d0c355c1a service nova] Creating event network-vif-plugged:100ec958-8a68-4db9-9f51-e4e889c6ddce for instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 on hv-cinder-79760 Jul 11 15:50:29.066307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-35aeefd9-63c8-4f00-9c83-aa1d0ab7b015 req-27da916d-b1ec-4d71-9910-c51d0c355c1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305378 Jul 11 15:50:29.066833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 63/114] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:29.205275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:29.206065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:29.214312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.214770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.215575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.218133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.316191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:29.316925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:29.323428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.324127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.324916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.325355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.470997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:29.481269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3f6579ae-ecd4-46f2-b6be-47cc75878935 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.280715 Jul 11 15:50:29.482160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 52/115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:29 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:29.565907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:29.567773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:29.577302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.578538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.579814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:29.580464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:29.586180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:29.595622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7912eb8c-3e26-4963-9e91-6e13f5737db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.283301 Jul 11 15:50:29.596769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 64/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:29 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:29.793942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:29.803032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4205289-ec9e-4e22-a262-5cba228e28ba tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.244602 Jul 11 15:50:29.814888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 53/117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:29 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:30.498926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:30.500268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:30.506799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.507513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:30.508271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.508906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:30.615638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:30.616233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:30.643819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.645840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:30.647043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.647478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:30.651989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:30.721997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:30.731612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d64e719d-7bf3-4a8c-9063-e29e09a773fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.237166 Jul 11 15:50:30.733102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 65/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:30 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:30.825687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:30.826752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:30.833923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.834934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:30.836092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:30.836783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:31.054097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:31.067199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb3af6da-5093-4c73-84c5-ae38f59a3fa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.457528 Jul 11 15:50:31.076441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 54/119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:30 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:31.082225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:31.090164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c6eecc9f-4263-43aa-b8da-2a2d018cc40c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.269037 Jul 11 15:50:31.090746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 66/120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:30 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:31.750698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:31.752016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:31.761310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:31.762875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:31.764513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:31.765566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:31.960255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:31.972187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3a17012f-63f2-46f0-a094-12e19f918665 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.225793 Jul 11 15:50:31.974180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 55/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:31 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:32.085420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:32.086034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:32.095712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.095712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:32.095712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.095712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:32.107282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:32.108022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:32.115264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.116263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:32.116539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:32.117307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.118098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:32.523626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:32.536888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf8dc680-5330-4093-8244-667da22298be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.457096 Jul 11 15:50:32.537763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 67/122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:32 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:32.647685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:32.659554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-248a9b42-0a55-495c-9ec1-d38b785384e1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.556237 Jul 11 15:50:32.661169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 56/123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:32 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:32.990869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:32.991481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:32.997543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.997989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:32.998753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:32.999688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.141113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:33.148891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-94e2dea9-5920-4a10-80a6-4f8aa0e8489c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.162017 Jul 11 15:50:33.149533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 68/124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:32 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:33.392219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-4667b629-5711-44ca-8407-ac06cc1488ee req-a39e40bf-a1fa-4d19-ad29-9f55d2c19104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9253b43a-7bea-41c3-9e1a-3e37e78d533b", "name": "network-vif-plugged", "status": "completed", "tag": "569881a6-8f34-4c5f-8e43-71e7594c6f67"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:33.400855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4667b629-5711-44ca-8407-ac06cc1488ee req-a39e40bf-a1fa-4d19-ad29-9f55d2c19104 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:33.401368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4667b629-5711-44ca-8407-ac06cc1488ee req-a39e40bf-a1fa-4d19-ad29-9f55d2c19104 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.413710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-4667b629-5711-44ca-8407-ac06cc1488ee req-a39e40bf-a1fa-4d19-ad29-9f55d2c19104 service nova] Creating event network-vif-plugged:569881a6-8f34-4c5f-8e43-71e7594c6f67 for instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b on hv-cinder-79760 Jul 11 15:50:33.419649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-4667b629-5711-44ca-8407-ac06cc1488ee req-a39e40bf-a1fa-4d19-ad29-9f55d2c19104 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Jul 11 15:50:33.422012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 57/125] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:33.560689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:33.565139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:33.576202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:33.576903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.578968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:33.579932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.683675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:33.685039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:33.704925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:33.705957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.707322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:33.707761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:33.905266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:33.934437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50dda8f0-c291-428a-8916-9c8b3a32bdb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.377330 Jul 11 15:50:33.939104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 69/126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:33 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:34.065620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:34.074442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-98e310ec-8335-44da-9c9c-7d59e4e177e8 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.400419 Jul 11 15:50:34.075160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 58/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:33 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:34.165694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:34.166304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:34.173187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:34.173990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:34.174966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:34.175391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:34.320084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:34.327936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4ae4f537-6aba-4849-9d73-292472afb39e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.166169 Jul 11 15:50:34.328692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 70/128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:34 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:34.963700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:34.965000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:34.971445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:34.972195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:34.973005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:34.973446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.094686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:35.095584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:35.103093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:35.103530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.104305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:35.104754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.134118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:35.142672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a1f4b35-9dc1-4ade-9524-9aebf0e0f3b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.183359 Jul 11 15:50:35.143597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 59/129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:34 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:35.257416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:35.263464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91b1fd18-c565-425e-958c-1d78d460f301 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.173573 Jul 11 15:50:35.264081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 71/130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:35 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:35.345822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:35.346427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:35.352616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:35.353058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.353811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:35.354238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.464276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-a6d613fe-f784-421b-acd4-0bd92403dd59 req-58ed035d-0249-42ba-a64c-2aab6f93091d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2901472e-529a-4ef6-a35e-0677479d2964", "name": "network-vif-plugged", "status": "completed", "tag": "248914ee-b4de-4e63-aafa-d5668dd61063"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:35.474325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-a6d613fe-f784-421b-acd4-0bd92403dd59 req-58ed035d-0249-42ba-a64c-2aab6f93091d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:35.474851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-a6d613fe-f784-421b-acd4-0bd92403dd59 req-58ed035d-0249-42ba-a64c-2aab6f93091d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:35.487043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-a6d613fe-f784-421b-acd4-0bd92403dd59 req-58ed035d-0249-42ba-a64c-2aab6f93091d service nova] Creating event network-vif-plugged:248914ee-b4de-4e63-aafa-d5668dd61063 for instance 2901472e-529a-4ef6-a35e-0677479d2964 on hv-cinder-79760 Jul 11 15:50:35.492184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-a6d613fe-f784-421b-acd4-0bd92403dd59 req-58ed035d-0249-42ba-a64c-2aab6f93091d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Jul 11 15:50:35.493051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 72/131] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:50:35.496691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:35.504742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3aa0be2a-bf83-43f3-8fb6-065177928c0b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.163081 Jul 11 15:50:35.505305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 60/132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:35 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:36.164632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:36.165658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:36.176281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.177069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.178310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.179028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.280983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:36.281961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:36.290108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.290646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.291487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.291989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.325896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:36.336600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40adedd4-d9f7-424a-8711-d422407e26ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.176401 Jul 11 15:50:36.337347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 73/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:36 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:36.423244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:36.435267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e68d086a-5808-4a41-b670-0a3140df2877 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.157964 Jul 11 15:50:36.436003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 61/134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:36 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:36.523488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:36.524238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:36.532157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.532763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.533703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:36.534236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:36.670617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:36.678898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2656d1e-be8f-4fb0-83ae-404686aa835e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.160348 Jul 11 15:50:36.679467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:36 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:37.353454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:37.354715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:37.366643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.367173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.368104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.368627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.457474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:37.458244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:37.465103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.465555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.466556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.467140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.548969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:37.558190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cdb28141-f9ca-474c-9346-4260e4a2641c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.208211 Jul 11 15:50:37.559246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 62/136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:37 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:37.618862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:37.627146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37fe002d-fee0-43f3-ac48-976046c21a12 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1314 microversion: 2.1 time: 0.173534 Jul 11 15:50:37.627940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 75/137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:37 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:37.696659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:37.697418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:37.703851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.704318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.705314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:37.705802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:37.853666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:37.862070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b62e0cc-a509-42f2-924d-37ea942f990c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.169618 Jul 11 15:50:37.862728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 63/138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:37 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:38.580625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:38.581726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:38.589184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.589629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:38.590503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.591058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:38.644156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:38.645671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:38.653958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.654500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:38.655535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.656071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:38.858636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:38.863683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:38.881727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ba0d59b-d602-40ab-ba5b-fea05f5244c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1321 microversion: 2.1 time: 0.305166 Jul 11 15:50:38.882593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 76/139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:38 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:38.896458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d55c3f0-b1b7-40e4-9efc-44c6d87e9e69 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1500 microversion: 2.1 time: 0.245841 Jul 11 15:50:38.896458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 64/140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:38 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:38.900440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:38.901372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:38.912055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.912541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:38.913317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:38.913747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:39.067439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:39.077894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4fc8c75c-e107-4670-99fc-ba4385c0ef3e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.190412 Jul 11 15:50:39.079114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 65/141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:38 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:39.600852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7e972fcf-19e8-462d-b507-0887fc682461 req-26952561-478b-4696-ad82-dc6dc2d10327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b13d806-c073-41ec-8b74-f0dfc037fa88", "name": "network-vif-plugged", "status": "completed", "tag": "bbde3788-fd0a-43b7-805f-a658829f18d7"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:39.613857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7e972fcf-19e8-462d-b507-0887fc682461 req-26952561-478b-4696-ad82-dc6dc2d10327 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:39.614308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7e972fcf-19e8-462d-b507-0887fc682461 req-26952561-478b-4696-ad82-dc6dc2d10327 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:39.638328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7e972fcf-19e8-462d-b507-0887fc682461 req-26952561-478b-4696-ad82-dc6dc2d10327 service nova] Creating event network-vif-plugged:bbde3788-fd0a-43b7-805f-a658829f18d7 for instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 on hv-cinder-79760 Jul 11 15:50:39.648648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7e972fcf-19e8-462d-b507-0887fc682461 req-26952561-478b-4696-ad82-dc6dc2d10327 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051183 Jul 11 15:50:39.649160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 77/142] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:39.900654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:39.902010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:39.911773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:39.912345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:39.913742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:39.915015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.096375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:40.097159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:40.109839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.111447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.112379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.113065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.115247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:40.129850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f7a6eb95-7f86-4b5e-a2bb-da6efdd08c07 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1515 microversion: 2.1 time: 0.234340 Jul 11 15:50:40.130585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 66/143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:39 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:40.158189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:40.159920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:40.171997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.172620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.173791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.174461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.242498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lazy-loading 'flavor' on Instance uuid 9253b43a-7bea-41c3-9e1a-3e37e78d533b {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:50:40.289176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:40.298635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5533f3cc-134a-4037-8dfa-52a18a966616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.207142 Jul 11 15:50:40.304925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 78/144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:40 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:40.430507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-741de166-8c7b-4009-ace3-1eb97800f24a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b/action" status: 200 len: 32 microversion: 2.1 time: 0.276937 Jul 11 15:50:40.431609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 67/145] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:50:40 2022] POST /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 15:50:40.441794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:40.442683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:40.453929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.454377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.455167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.455602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.551610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d04ffd15-d78f-41e9-8a5b-d8554fb9650d"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:40.553225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:40.569043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.570026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.571056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:40.571763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:40.680637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:40.690756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0132f537-c40c-45ab-8848-50f394de955a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.253641 Jul 11 15:50:40.691427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 79/146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:40 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:41.073644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:41.097893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-93687888-ff37-444a-8bb8-56d82915fd74 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "POST /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550408 Jul 11 15:50:41.098818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 68/147] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:50:40 2022] POST /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:50:41.316415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:41.317273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:41.323501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:41.324158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:41.325350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:41.325932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:41.508505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:41.522806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bfef68bd-519c-4e24-8b0d-64bdb1fe7472 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1364 microversion: 2.1 time: 0.210471 Jul 11 15:50:41.523770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 80/148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:41 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:41.708237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:41.708966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:41.715558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:41.716004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:41.716797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:41.717225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:41.852974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:41.860680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-16ec45cd-ae37-48c9-8062-0d4e6094b8b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.157156 Jul 11 15:50:41.861244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 69/149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:41 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:42.542926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:42.543546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:42.550680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.551131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:42.551883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.552316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:42.714514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:42.722463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2ecbcfe1-7ea4-4b5b-b1cc-3e6fbf71d428 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1549 microversion: 2.1 time: 0.185483 Jul 11 15:50:42.723037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 81/150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:42 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:42.742618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:42.743140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:42.753040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.753551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:42.755332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.755909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:42.883748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:42.884595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:42.891772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-682ae399-be45-483f-bbee-1a531df58392 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154738 Jul 11 15:50:42.891772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 70/151] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 15:50:42 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:50:42.897377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.897827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:42.898599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:42.899032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:43.772085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:43.786199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eb5fc948-a6e8-49c6-9a57-444a002285e7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.912055 Jul 11 15:50:43.787257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 82/152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:42 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:50:44.821376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:44.821991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:44.831224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-ed16ae28-a3bb-44fa-8d9c-0a2aa42a5b6f req-ce04717c-b9cb-4927-8cbb-ce120a945153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b13d806-c073-41ec-8b74-f0dfc037fa88", "tag": "bbde3788-fd0a-43b7-805f-a658829f18d7"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:50:44.852653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ed16ae28-a3bb-44fa-8d9c-0a2aa42a5b6f req-ce04717c-b9cb-4927-8cbb-ce120a945153 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:44.852874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:44.853630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:44.854863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:44.856353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:44.859486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-ed16ae28-a3bb-44fa-8d9c-0a2aa42a5b6f req-ce04717c-b9cb-4927-8cbb-ce120a945153 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:44.900039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-ed16ae28-a3bb-44fa-8d9c-0a2aa42a5b6f req-ce04717c-b9cb-4927-8cbb-ce120a945153 service nova] Creating event network-changed:bbde3788-fd0a-43b7-805f-a658829f18d7 for instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 on hv-cinder-79760 Jul 11 15:50:44.941435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-ed16ae28-a3bb-44fa-8d9c-0a2aa42a5b6f req-ce04717c-b9cb-4927-8cbb-ce120a945153 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114381 Jul 11 15:50:44.945990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 83/153] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:50:45.158454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:45.167699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-63a1c399-5d48-4eab-8833-0b5acdccc525 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.352266 Jul 11 15:50:45.168979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 71/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:44 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:46.193083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:46.194429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:46.209866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=76 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.219117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:46.220577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:46.221594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:46.223352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:46.401983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:46.439882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3484cab2-981c-4692-a11c-5ff99b9aa2bd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.257010 Jul 11 15:50:46.444336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 84/155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:46 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:47.457467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:47.459507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:47.462993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=66 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:47.473901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:47.474353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:47.475125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:47.475556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:47.697370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:47.706784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57f60137-eb7a-4c1f-89b5-9b58f64978c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.253192 Jul 11 15:50:47.707890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 72/156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:47 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:48.726364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:48.727286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:48.734079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:48.734653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:48.735618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:48.736140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:48.931816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:48.940211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a079a4cb-5690-481b-864c-0b29d98f35f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.219819 Jul 11 15:50:48.940827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 85/157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:48 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:49.959626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:49.960561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:49.968101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:49.968855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:49.969915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:49.970352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:50.109836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:50.117609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a1f39ba-09e0-4995-b6c3-d88d8967a96d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.164038 Jul 11 15:50:50.118258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 73/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:49 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:51.136088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:51.136726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:51.143120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:51.143572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:51.144445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:51.144899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:51.148853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:51.287220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:51.295995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14a10d85-9eca-4e05-aca5-11e5d366c966 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.163184 Jul 11 15:50:51.297313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 86/159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:51 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:52.315061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:52.315638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:52.324529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:52.324975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:52.325803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:52.326217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:52.463338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:52.471078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-745ed7aa-50e4-4c35-8793-26095e3005c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.160805 Jul 11 15:50:52.471687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 74/160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:52 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:53.489634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:53.490666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:53.497064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:53.497768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:53.498688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:53.499466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:53.696497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:53.706290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-deda7144-dc6f-400e-a5f2-687be991b4c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.222347 Jul 11 15:50:53.707111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 87/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:53 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:54.180478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:54.180902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:54.189632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.189632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.189632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.189632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.215312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 15:50:54.313710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3c1ae23-76ec-470d-a70d-a0ecf9872225 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 204 len: 0 microversion: 2.1 time: 0.136583 Jul 11 15:50:54.314322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 75/162] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:50:54 2022] DELETE /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:50:54.322617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:54.323199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:54.331764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.332207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.332992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.333614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.474500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:54.483277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-098276b3-9e62-47a5-aa3d-aefc02ca389d tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.164485 Jul 11 15:50:54.483865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 88/163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:54 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:54.723626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:54.724405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:54.731231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.731683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.732664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:54.733128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:54.918896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:54.927921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cdff0955-c956-4186-a0e4-a41f3a3d5bbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.208403 Jul 11 15:50:54.937180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 76/164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:54 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:55.501790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:55.503860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:55.511963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:55.513045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:55.517060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:55.518078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:55.657101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:55.666861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-140ace4d-7720-4a4d-a5c6-be3329306b48 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.169249 Jul 11 15:50:55.667433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 89/165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:55 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:55.945274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:55.945902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:55.953223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:55.953669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:55.954419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:55.954843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:56.101813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:56.111787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5b872531-32e0-4c52-9de5-2cb8c22db19d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.170457 Jul 11 15:50:56.112360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 77/166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:55 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:56.685006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:56.685613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:56.691938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:56.692401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:56.693153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:56.693573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:56.831028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:56.845256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d08a3a42-1cd6-4614-9154-a8848a807b8b tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.163789 Jul 11 15:50:56.846187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 90/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:56 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:57.132814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:57.133385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:57.140181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:57.140859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:57.141629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:57.142058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:57.280156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:57.287903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-148ef509-6386-4b7b-91fe-8dcdbf05a8e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.159144 Jul 11 15:50:57.292098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 78/168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:57 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:57.862353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:57.862923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:57.876393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:57.877323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:57.878408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:57.878829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:58.039648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:58.050426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d55ac4a-1640-4ede-b898-0a2ba8eec93f tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.191851 Jul 11 15:50:58.060342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 91/169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:57 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:58.304829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:58.305471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:58.312943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:58.313759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:58.314539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:58.315127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:58.460971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:58.469100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-75e2cac3-447b-474b-9615-3faf03292a35 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.168424 Jul 11 15:50:58.469687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 79/170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:58 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:59.067229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:59.067837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:59.074122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:59.074558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:59.075302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:59.075746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:59.210770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:59.218914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c0533403-021c-4d2b-a1b9-4dafdb05bd09 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.155655 Jul 11 15:50:59.219475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 92/171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:59 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:50:59.486568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:50:59.487191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:50:59.494622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:59.495075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:59.496217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:50:59.496989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:50:59.833523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:50:59.841974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-18358fd4-757f-4642-ba5a-bcb4612d0cbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.359829 Jul 11 15:50:59.842613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 80/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:50:59 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:00.236320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:00.237055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:00.243515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:00.244040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:00.244910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:00.245369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:00.383625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:00.392139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab6a7087-2ac2-49f4-89ff-6e18875b50e3 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1552 microversion: 2.1 time: 0.159841 Jul 11 15:51:00.392834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 93/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:00 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:00.501775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-3ff27718-7d5f-46b8-8e7f-9a28fae74f08 req-93061568-3ada-4110-a97b-123285f4e24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5a5cc5-eb58-4a02-8306-33f472159b67", "name": "network-vif-deleted", "tag": "100ec958-8a68-4db9-9f51-e4e889c6ddce"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:00.521601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3ff27718-7d5f-46b8-8e7f-9a28fae74f08 req-93061568-3ada-4110-a97b-123285f4e24a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:00.522040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3ff27718-7d5f-46b8-8e7f-9a28fae74f08 req-93061568-3ada-4110-a97b-123285f4e24a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:00.548922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-3ff27718-7d5f-46b8-8e7f-9a28fae74f08 req-93061568-3ada-4110-a97b-123285f4e24a service nova] Creating event network-vif-deleted:100ec958-8a68-4db9-9f51-e4e889c6ddce for instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 on hv-cinder-79760 Jul 11 15:51:00.554094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-3ff27718-7d5f-46b8-8e7f-9a28fae74f08 req-93061568-3ada-4110-a97b-123285f4e24a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056330 Jul 11 15:51:00.554740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 81/174] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:00.859455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:00.860053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:00.866313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:00.866763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:00.867507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:00.867931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:01.003272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:01.011593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d5849f5-eeae-4602-b8fb-688c8e2ff5b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.156390 Jul 11 15:51:01.012200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 94/175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:00 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:01.414344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:01.415500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:01.424082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:01.424561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:01.425322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:01.425755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:01.488403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:01.498319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a317b60-12f2-42ba-bff8-3cb1c6800db5 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1345 microversion: 2.1 time: 0.090647 Jul 11 15:51:01.499171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 82/176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:01 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:02.031957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:02.032657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:02.041403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:02.041986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:02.042924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:02.043364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:02.194049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:02.205523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-851aed57-0106-4aef-a93e-31dae4a60b52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.179722 Jul 11 15:51:02.206300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 95/177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:02 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:51:02.515663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:02.516878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:02.524927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:02.525369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:02.526138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:02.526588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:02.593324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e395655fb14e3b92ed88eb3ea231db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf151ebb2425421d8cdc3e2773fbd558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:02.601989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dba2c2cd-8132-4869-abbe-3d3128381f9c tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 200 len: 1345 microversion: 2.1 time: 0.090757 Jul 11 15:51:02.602553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 83/178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:02 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:03.224382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:03.225062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:03.231726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.232120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.233094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.233594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.368627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:03.376176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-46282e05-c4c3-4b9d-931d-7fed479a1d92 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.156877 Jul 11 15:51:03.376796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 96/179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:03 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:03.623302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:03.624424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:03.635625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.637099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.639045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.640046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.644472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:03.657777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] HTTP exception thrown: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Request method failure captured: Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 HTTP/1.1 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEafHqoyQWcFhmIGzwnERngSlFkKNW7B1ic_xWPSEke6OZNRSc7UWPeqDHw9Ud__7Ssi6QXCKQU80fhcjHN5SHKlPGnu5wrPEEl19lRQpAKcl73wfMISltWBaVWUUJtcp90icnOKELm4aq9Fpk7R6cd6bMr5nCfbtr6jpGxHI5ZQLIU Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:51:03.662536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf151ebb2425421d8cdc3e2773fbd558"}]}] Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: c0e395655fb14e3b92ed88eb3ea231db Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.664022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '7d5a5cc5-eb58-4a02-8306-33f472159b67'} Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:51:03.665015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.667867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Returning 404 to user: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:51:03.667867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-de8a6875-9384-4cfe-b45f-bacd5bf5f6a9 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 404 len: 111 microversion: 2.1 time: 0.047474 Jul 11 15:51:03.667867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 84/180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:03 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:03.768367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:03.769388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:03.775328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.775773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.776558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:03.776985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:03.821212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] HTTP exception thrown: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Request method failure captured: Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67/os-volume_attachments HTTP/1.1 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEafHqoyQWcFhmIGzwnERngSlFkKNW7B1ic_xWPSEke6OZNRSc7UWPeqDHw9Ud__7Ssi6QXCKQU80fhcjHN5SHKlPGnu5wrPEEl19lRQpAKcl73wfMISltWBaVWUUJtcp90icnOKELm4aq9Fpk7R6cd6bMr5nCfbtr6jpGxHI5ZQLIU Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:51:03.825313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf151ebb2425421d8cdc3e2773fbd558"}]}] Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: c0e395655fb14e3b92ed88eb3ea231db Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.826732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'server_id': '7d5a5cc5-eb58-4a02-8306-33f472159b67'} Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:51:03.827966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:03.829289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:03.830589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Returning 404 to user: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:51:03.830589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-56de6f4c-9542-443b-a709-47eca16b88b1 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062694 Jul 11 15:51:03.830589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 97/181] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:51:03 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:04.392938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:04.393659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:04.400616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:04.400999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:04.401756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:04.402181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:04.545614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:04.555439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e49196d5-eae5-4050-ad9b-79bc2befd6bb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.166955 Jul 11 15:51:04.556008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 85/182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:04 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:05.146346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:05.146963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:05.153557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.154023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.154929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.155355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.169384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] HTTP exception thrown: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Request method failure captured: Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 HTTP/1.1 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEafHqoyQWcFhmIGzwnERngSlFkKNW7B1ic_xWPSEke6OZNRSc7UWPeqDHw9Ud__7Ssi6QXCKQU80fhcjHN5SHKlPGnu5wrPEEl19lRQpAKcl73wfMISltWBaVWUUJtcp90icnOKELm4aq9Fpk7R6cd6bMr5nCfbtr6jpGxHI5ZQLIU Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:51:05.171783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf151ebb2425421d8cdc3e2773fbd558"}]}] Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: c0e395655fb14e3b92ed88eb3ea231db Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.173257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '7d5a5cc5-eb58-4a02-8306-33f472159b67'} Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:51:05.177017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.178280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.179547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Returning 404 to user: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:51:05.179547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8404ada-32b8-49d6-a1bb-c8da08539863 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 404 len: 111 microversion: 2.1 time: 0.031129 Jul 11 15:51:05.179547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 98/183] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:51:05 2022] DELETE /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:05.183068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:05.189134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] [instance: 7d5a5cc5-eb58-4a02-8306-33f472159b67] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:05.190717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.191156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.191943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.192410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.207165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] HTTP exception thrown: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Request method failure captured: Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 HTTP/1.1 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEafHqoyQWcFhmIGzwnERngSlFkKNW7B1ic_xWPSEke6OZNRSc7UWPeqDHw9Ud__7Ssi6QXCKQU80fhcjHN5SHKlPGnu5wrPEEl19lRQpAKcl73wfMISltWBaVWUUJtcp90icnOKELm4aq9Fpk7R6cd6bMr5nCfbtr6jpGxHI5ZQLIU Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:51:05.208646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf151ebb2425421d8cdc3e2773fbd558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf151ebb2425421d8cdc3e2773fbd558"}]}] Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: bf151ebb2425421d8cdc3e2773fbd558 Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-DeleteServersTestJSON-2005897439 Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: c0e395655fb14e3b92ed88eb3ea231db Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-DeleteServersTestJSON-2005897439-project Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.210418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '7d5a5cc5-eb58-4a02-8306-33f472159b67'} Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:51:05.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. Jul 11 15:51:05.212853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:51:05.214311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] Returning 404 to user: Instance 7d5a5cc5-eb58-4a02-8306-33f472159b67 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:51:05.214311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-736b5ece-253a-4be8-8979-28be0788a679 tempest-DeleteServersTestJSON-2005897439 tempest-DeleteServersTestJSON-2005897439-project] 10.222.0.26 "GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67" status: 404 len: 111 microversion: 2.1 time: 0.031260 Jul 11 15:51:05.214311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 86/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:05 2022] GET /compute/v2.1/servers/7d5a5cc5-eb58-4a02-8306-33f472159b67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:51:05.572267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:05.572936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:05.580078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.580600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.581333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:05.581756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:05.730717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:05.738567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bc281105-20c8-4000-b809-5730a9340f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.170348 Jul 11 15:51:05.739136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 99/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:05 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:06.759853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:06.761649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:06.771841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:06.773051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:06.774994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:06.776111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:06.938542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:06.946829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf09469d-3021-43b8-91e1-22373e7de63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.194882 Jul 11 15:51:06.947948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 87/186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:06 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:07.964932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:07.967771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:07.974673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:07.975330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:07.977519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:07.978167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:08.272897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:08.291391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-19166a99-5440-498f-8692-448c5ec4938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.329882 Jul 11 15:51:08.294889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 100/187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:07 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:09.311122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:09.312536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:09.324949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:09.325690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:09.327119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:09.328171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:09.578786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:09.590306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-82d2194c-a404-4641-8dd9-9a3b5cc594b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.283381 Jul 11 15:51:09.591414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 88/188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:09 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:10.607807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:10.608604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:10.614881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:10.615320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:10.616076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:10.616566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:10.764375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:10.772144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eebaaa2b-9486-4504-992c-5467028e2cdb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.168227 Jul 11 15:51:10.772759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 101/189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:10 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:11.793190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:11.793891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:11.801389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:11.801937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:11.803018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:11.803665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:11.981934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:11.991149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-429984b6-033f-4ba5-bfbb-10aba9fdaed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.201816 Jul 11 15:51:11.992043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 89/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:11 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:13.010115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:13.011279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:13.033687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:13.034140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:13.034932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:13.036517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:13.325459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:13.340651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b29c511-6ace-44c1-883e-3ae272376377 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.336018 Jul 11 15:51:13.341859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 102/191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:13 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:14.359977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:14.360964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:14.368447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:14.368903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:14.369702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:14.370135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:14.579385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:14.589879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a0f108ae-7ead-494b-8fd7-99ba600d5f1f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.234163 Jul 11 15:51:14.591863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 90/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:14 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:15.596023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c352f44-1012-4321-9a11-13db964bedec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'create', calling method: .version_select at 0x7f20b80c6790>, body: {"keypair": {"name": "tempest-keypair-439521934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF7uc4Qweus94ydvSK3mOqiiBVOr6/VGO/SnFOaD20v9FV3qhG31bxj4jSATgGFtwJ6/09qkrBnm9tMiJruVIC4I+JfMEjqsXWKPYxwJarl0JyAAIx/KfQbLJSOKcaIqQ=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:15.607951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:15.608736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:15.618318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:15.618754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:15.619854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:15.620729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:15.628851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c352f44-1012-4321-9a11-13db964bedec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:51:15.632879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7c352f44-1012-4321-9a11-13db964bedec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for user 046cf5e98eca41c0a532e84f777efaab and project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:51:15.698383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c352f44-1012-4321-9a11-13db964bedec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.310654 Jul 11 15:51:15.702293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 103/193] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 11 15:51:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 15:51:15.894826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:15.905901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1e0b8e93-cc0c-4648-b3ff-28a037432123 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.302023 Jul 11 15:51:15.906902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 91/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:15 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:16.923250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:16.923965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:16.926091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:16.932831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:16.933362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:16.934212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:16.934713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:17.169608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:17.184970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-887e7c5e-e0dc-41a6-bbe8-9facd14858a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.263914 Jul 11 15:51:17.185596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 104/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:16 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:17.748421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1875683797", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4796293e-9cfd-499e-8fa0-df1de6a745bf"}], "security_groups": [{"name": "tempest-securitygroup--244888673"}], "key_name": "tempest-keypair-439521934", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:17.757697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:18.210550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:18.211461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:18.218951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:18.219336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:18.220112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:18.220761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:18.225435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:18.374697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:18.383297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ce20bcd-225d-4eca-955e-61247950cdb6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.184657 Jul 11 15:51:18.383854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 105/196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:18 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:19.400630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:19.401240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:19.409085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:19.409533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:19.410303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:19.410734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:19.554125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:19.562095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-075da2e2-d058-44b8-a4a2-116f26ad36b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.165681 Jul 11 15:51:19.562688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 106/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:19 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:20.578745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:20.579307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:20.585725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:20.586137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:20.587050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:20.587633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:20.733680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:20.741249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4a14956c-dbf0-467a-9c39-3d9667f0a2ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.166321 Jul 11 15:51:20.741815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 107/198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:20 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:51:21.458852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] validate_networks() for [('4796293e-9cfd-499e-8fa0-df1de6a745bf', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:51:21.771727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:21.772991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:21.780248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:21.780719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:21.781479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:21.781906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:21.952999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:51:21.953649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:51:21.954503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:51:21.955170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:51:21.955586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:51:21.965294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:21.965743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:21.966529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:21.967252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:21.985287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:51:21.989817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for user 046cf5e98eca41c0a532e84f777efaab and project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:51:21.999645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:22.001929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:51:22.004204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:51:22.007951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-75cc12d7-96c2-4867-bb36-a71888d20691 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.253074 Jul 11 15:51:22.008588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 108/199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:21 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:51:22.055453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d32ed3c3-9be7-4e19-b436-ce391cc86bfc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.312507 Jul 11 15:51:22.056320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 92/200] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 11 15:51:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 4314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 11 15:51:22.066837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:22.067651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:22.201510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:22.212003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:22.213556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:22.217670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fdb42137-d6a6-4bbb-b33e-53425ba95cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1281 microversion: 2.20 time: 0.154874 Jul 11 15:51:22.218440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 109/201] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:23.025600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:23.026187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:23.034172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:23.034639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:23.035395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:23.035822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:23.184053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:23.193895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fd5bf765-b98a-4c81-bf59-725690020199 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.172737 Jul 11 15:51:23.204450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 93/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:23 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:23.236866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:23.237461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:23.243796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:23.244231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:23.245007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:23.245430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:23.315650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:23.325127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:23.327341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:23.330387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d5296559-3a39-41d2-a0c2-121baf576c0f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1341 microversion: 2.20 time: 0.097339 Jul 11 15:51:23.331191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 110/203] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:24.211272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:24.211887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:24.218513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:24.218961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:24.219716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:24.220167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:24.350185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:24.350907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:24.357784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:24.358738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:24.359514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:24.359945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:24.389927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:24.397697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-853c0a25-0c87-4fff-bfa4-da7d064930c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.190583 Jul 11 15:51:24.398430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 94/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:24 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:24.502133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:24.519773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:24.522085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:24.523746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0990bf51-28e4-4a0c-a276-274dd9a3f49b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.177766 Jul 11 15:51:24.525117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 111/205] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:24.769141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-9f7dde9a-0405-417f-93d7-7ebc3229c49b req-55e7290d-ee1e-4602-a197-beab2c7a3240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:24.783808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9f7dde9a-0405-417f-93d7-7ebc3229c49b req-55e7290d-ee1e-4602-a197-beab2c7a3240 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:24.784537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9f7dde9a-0405-417f-93d7-7ebc3229c49b req-55e7290d-ee1e-4602-a197-beab2c7a3240 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:24.805621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-9f7dde9a-0405-417f-93d7-7ebc3229c49b req-55e7290d-ee1e-4602-a197-beab2c7a3240 service nova] Creating event network-changed:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 15:51:24.815187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-9f7dde9a-0405-417f-93d7-7ebc3229c49b req-55e7290d-ee1e-4602-a197-beab2c7a3240 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049380 Jul 11 15:51:24.815913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 95/206] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:51:25.415348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:25.415868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:25.426001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:25.426001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:25.426001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:25.426001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:25.543584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:25.544403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:25.551080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:25.551849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:25.552849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:25.553298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:25.564282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:25.571920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8e7bfc2-e149-459e-bacf-d9fbdaf8cbe9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.160561 Jul 11 15:51:25.572800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 112/207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:25 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:25.701854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:25.713569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:25.715832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:25.717097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c324f720-3b78-4983-8f87-8026e1123fcd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.178210 Jul 11 15:51:25.717654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 96/208] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:26.593020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:26.593653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:26.603550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:26.604054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:26.605253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:26.605803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:26.735558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:26.736095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:26.743407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:26.743858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:26.744474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:26.744649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:26.745259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:26.752511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-220a87e7-117e-4e74-b994-9e98d69e3099 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.165483 Jul 11 15:51:26.753093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 113/209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:26 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:26.885055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:26.894107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:26.896284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:26.898521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-774d312d-97d9-4b26-a13f-a3b32080b60f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.167134 Jul 11 15:51:26.899485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 97/210] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:27.770006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:27.770603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:27.777049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:27.777501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:27.778261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:27.778684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:27.919559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:27.919559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:27.920208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:27.924834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:27.925462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:27.926664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:27.927112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:27.930371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-275ca18d-74ed-4163-aca1-bd0466e5a934 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.164240 Jul 11 15:51:27.930955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 114/211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:27 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:28.076570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:28.085089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:28.086855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:28.088237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45ba4475-644f-4e65-8e3c-d2474cb823db tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.174822 Jul 11 15:51:28.089039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 98/212] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:28.947385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:28.947954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:28.954592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:28.955044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:28.955876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:28.956260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:29.101017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:29.106569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:29.107286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:29.110267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bfdc9ee5-aa2c-4682-94ee-cdf069538e75 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.166920 Jul 11 15:51:29.111434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 115/213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:28 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:29.113902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:29.114344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:29.115123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:29.115555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:29.264885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:29.273122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:29.274703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:29.275872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1369ff8b-851f-4182-921f-b8679099d965 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.173155 Jul 11 15:51:29.276720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 99/214] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:30.131694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:30.131694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:30.138511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:30.139626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:30.140589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:30.141025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:30.278286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:30.286123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d01fc928-cbdc-4e9d-b905-6e1588cb2435 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.160038 Jul 11 15:51:30.286686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 116/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:30 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:30.296693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:30.297322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:30.303993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:30.304481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:30.305245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:30.305677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:30.449833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:30.458730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:30.460584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:30.461678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7a7094fa-29a9-4d08-84de-d2adf6a932bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.169265 Jul 11 15:51:30.462230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 100/216] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:31.309047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:31.310203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:31.319038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:31.319494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:31.320416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:31.321059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:31.471685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:31.479739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:31.480472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:31.480577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-85cc6b8c-6f1d-45bf-8ccc-293cbca49bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.180923 Jul 11 15:51:31.481199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 117/217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:31 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:31.487304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:31.487830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:31.488628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:31.489060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:31.622550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:31.631126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:31.632958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:31.634069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8353a5f7-394a-4f86-8171-6d568c5a81aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.158218 Jul 11 15:51:31.634849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 101/218] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:32.204146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:32.204749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:32.210382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:32.212228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.212799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.213683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.214280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.247536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1108cdaf-7a22-431e-8a9d-ad8a2f657ff0 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/ips" status: 200 len: 145 microversion: 2.1 time: 0.047889 Jul 11 15:51:32.249309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 118/219] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:51:32 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:32.505190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:32.507196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:32.512810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:32.521250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:32.535644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.541927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.543464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.544210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.653909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:32.656654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:32.678944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.683201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.686485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:32.687132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:32.751990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:32.761052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-22273a1c-7a4e-4ec7-b3b7-a6b5deec6f78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.265527 Jul 11 15:51:32.761895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 102/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:32 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:32.866332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:32.878235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:32.879748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:32.880886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-406fc201-9454-4f14-9a58-aa73e504369c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.232408 Jul 11 15:51:32.881633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 119/221] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:33.778677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:33.780308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:33.795449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:33.796125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:33.797176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:33.797831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:33.820383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:33.901483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:33.902793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:33.911197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:33.912397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:33.913412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:33.914031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:34.021625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:34.032643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8457dbd2-dd6b-4156-9b44-30ba0500690f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.258265 Jul 11 15:51:34.033563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 103/222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:33 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:34.153631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:34.166048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:34.168060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:34.169522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0cc035eb-e0ba-4a70-8651-5aa21bddf2d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.272228 Jul 11 15:51:34.180996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 120/223] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:35.052533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:35.053970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:35.060807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.061512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.062864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.063368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.192642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:35.193010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:35.205535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.206164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.207100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.207676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.233978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:35.242854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e1ad14a2-c1c8-467d-aa64-0777ff981727 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.195786 Jul 11 15:51:35.243365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 104/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:35 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:35.374770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:35.383154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:35.384689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:35.385772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1230850a-c714-458c-90e6-824e7eb29de9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.200049 Jul 11 15:51:35.386358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 121/225] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:35.530913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eae6e4ca-ddf7-42f7-9849-dcc7aa961f59"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:35.532514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:35.539397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.539944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.540937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:35.541364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:35.837710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a2f4412-92b9-405b-b21c-93a73cf13113 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311662 Jul 11 15:51:35.841432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 105/226] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:51:35 2022] POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:36.259784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:36.260480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:36.268910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:36.269715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:36.271230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:36.272090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:36.409133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:36.410034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:36.418196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:36.419178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:36.420338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:36.420887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:36.588440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:36.597385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd6cf33c-6721-47db-95c7-f0e38f7a31fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.341376 Jul 11 15:51:36.598015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 122/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:36 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:36.696626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:36.705227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:36.706751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:36.708204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aabaa85b-1257-4f14-aca4-c406a95b4c15 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.307213 Jul 11 15:51:36.709619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 106/228] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:37.618098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:37.619682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:37.648500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:37.650228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:37.651882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:37.653488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:37.661721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:37.727108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:37.728546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:37.736103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:37.737078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:37.738257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:37.738844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:38.185032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:38.197485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a89391b4-3c3b-4ac8-8da1-f09f4ee92d6c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.585391 Jul 11 15:51:38.200448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 123/229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:37 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:38.208717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:38.222481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:38.223987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:38.225992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e9572cc-545b-4b1b-8223-c8fa72ebd674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.502928 Jul 11 15:51:38.227083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 107/230] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:39.226085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:39.226737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:39.242533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:39.243153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:39.244162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:39.245526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:39.253447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:39.254670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:39.262401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:39.263045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:39.265815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:39.266416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:39.566131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:39.575166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c42fb180-462f-43be-825b-bb79b3c2b130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.364024 Jul 11 15:51:39.575557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 124/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:39 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:39.636031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:39.665038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:39.666994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:39.668639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-193b4d8b-9edf-42ba-a89d-b0d9183d2531 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.428499 Jul 11 15:51:39.669631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 108/232] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:40.599793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:40.601476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:40.610391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:40.612051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:40.613586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:40.614289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:40.687912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:40.689209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:40.702992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:40.703861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:40.714226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:40.717836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:40.834650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:40.843053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ae1358e-2261-4ede-84d8-de7381aed2d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1521 microversion: 2.1 time: 0.249434 Jul 11 15:51:40.856643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 125/233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:40 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:40.944047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:40.965282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:40.971375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:40.973071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77806a69-ee46-4078-8f98-b6c2086c8678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.289870 Jul 11 15:51:40.973807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 109/234] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:41.865371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:41.866749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:41.880155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:41.881025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:41.882185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:41.887995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:41.994232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:41.995789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:42.016643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:42.019631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:42.020834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:42.021419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:42.445389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:42.455147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:42.464081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc573834-a8aa-4e9b-8217-e2efc1172d25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1501 microversion: 2.1 time: 0.604057 Jul 11 15:51:42.472372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 126/235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:41 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1501 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:42.472889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:42.472889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:42.487536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:42.487823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:42.490578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95ccc876-a913-4440-a44a-3ed09864efc4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.502216 Jul 11 15:51:42.491182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 110/236] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:42.513867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:42.514581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:42.516421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:42.517037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:42.750508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:42.758988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-85df3b3e-dc44-4462-bf30-3400c4152e58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1516 microversion: 2.1 time: 0.277080 Jul 11 15:51:42.759961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 127/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:42 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:43.509699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:43.510351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:43.528656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:43.529892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:43.530827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:43.531408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:43.684234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:43.693925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:43.695643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:43.696730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43587390-9d9b-4de0-9228-7bf5e364fe4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.191746 Jul 11 15:51:43.698193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 111/238] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:43.778271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57df9baa-fb5a-4aac-9f2f-0626d204411b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:43.785022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57df9baa-fb5a-4aac-9f2f-0626d204411b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:43.786217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57df9baa-fb5a-4aac-9f2f-0626d204411b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:43.861781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57df9baa-fb5a-4aac-9f2f-0626d204411b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Going to try to stop instance {{(pid=124242) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 15:51:43.922453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57df9baa-fb5a-4aac-9f2f-0626d204411b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action" status: 202 len: 0 microversion: 2.1 time: 0.147746 Jul 11 15:51:43.926824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 128/239] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:51:43 2022] POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:51:43.932605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:43.933224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:43.951445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:43.951921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:43.952872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:43.953309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.207913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:44.219294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d643ac26-3905-4cef-8b91-58838db08d69 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.290724 Jul 11 15:51:44.220216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 112/240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:43 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:44.331212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:44.332781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:44.349101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.349650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.350654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.351299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.388753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lazy-loading 'flavor' on Instance uuid 2901472e-529a-4ef6-a35e-0677479d2964 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:51:44.545159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26ba2ec3-8d13-40da-b7df-6d75928a3dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/action" status: 200 len: 32 microversion: 2.1 time: 0.215040 Jul 11 15:51:44.545950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 129/241] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:51:44 2022] POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 15:51:44.559379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:44.562395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:44.590712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.591779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.594154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.595057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.724793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:44.725493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:44.745671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.747504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.749539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:44.750566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:44.947233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:44.967781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-656e8b70-e4f5-4188-a2d9-a0d74087808b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.412388 Jul 11 15:51:44.969100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 113/242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:44 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:45.097590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:45.112075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:45.114580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:45.121203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a3beeff5-eda0-4b4b-add5-543296361239 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.396369 Jul 11 15:51:45.135309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 130/243] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:45.237215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:45.238215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:45.245131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:45.245839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:45.246952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:45.247623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:45.425412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:45.434196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78e1c588-0b3c-4381-b1a2-5bd0a02f5492 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.200920 Jul 11 15:51:45.435319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 114/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:45 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:51:45.617657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-499a7688-ac27-4eca-bd4d-dc88e7022ebf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Action: 'create', calling method: .version_select at 0x7f20b3e1b8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1629573614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG6ZpcDuiSLtaOb5bWuzEzaC/FXTOv43zSZ+PoT2wfW10ksS8dIg5+jrRpzmwA9ZcXCJB9KXqkLHtJIip5jj6uaibp5WmTdAi3Xne7aNQOLnA2d+EFk1LsC0coT03NHkg=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:45.637087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-499a7688-ac27-4eca-bd4d-dc88e7022ebf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Getting quotas for project 34616afcc7d2411992085fbb829ec4d8. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:51:45.641571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-499a7688-ac27-4eca-bd4d-dc88e7022ebf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Getting quotas for user 0c2fbf5d3064479a909e7547a050ef5e and project 34616afcc7d2411992085fbb829ec4d8. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:51:45.675864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-499a7688-ac27-4eca-bd4d-dc88e7022ebf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.267926 Jul 11 15:51:45.680333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 131/245] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 15:51:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:45.990870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:45.992226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:45.999796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.000708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.001810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.002442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.144162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:46.145851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:46.158970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.159535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.160541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.161243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.311235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:46.320382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3dcd3613-18a1-4216-ab4c-30f280b09669 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.335502 Jul 11 15:51:46.321664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 115/246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:45 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:46.335988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-dd3925e1-956d-4815-bb3a-93884576840c req-36897a66-ef1d-4d52-9165-7b9edb19b4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "name": "network-vif-plugged", "status": "completed", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:46.347779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-dd3925e1-956d-4815-bb3a-93884576840c req-36897a66-ef1d-4d52-9165-7b9edb19b4bb service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.348280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-dd3925e1-956d-4815-bb3a-93884576840c req-36897a66-ef1d-4d52-9165-7b9edb19b4bb service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.379010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-dd3925e1-956d-4815-bb3a-93884576840c req-36897a66-ef1d-4d52-9165-7b9edb19b4bb service nova] Creating event network-vif-plugged:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 15:51:46.390786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-dd3925e1-956d-4815-bb3a-93884576840c req-36897a66-ef1d-4d52-9165-7b9edb19b4bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062691 Jul 11 15:51:46.391649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 116/247] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:46.417773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:46.428796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:46.431615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:46.433433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d9698679-6627-4536-9b60-07c440189f87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.293572 Jul 11 15:51:46.434165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 132/248] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:46.452204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:46.453300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:46.462828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.463559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.465521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:46.466306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:46.695601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:46.712987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b8581908-1112-4cd1-83f5-c37f205fa80c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.265396 Jul 11 15:51:46.715573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 117/249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:46 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:47.338015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:47.338620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:47.341869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:47.345746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.346185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:47.346960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.347380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:47.451571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:47.452470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:47.459214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.459934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:47.461252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.461881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:47.517255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:47.526618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50981045-47d6-4b00-8bc1-b150e64d5247 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.192169 Jul 11 15:51:47.527475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 133/250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:47 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:47.608739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:47.617341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:47.618859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:47.619947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1ebbf8d2-bead-4ad0-af86-2c7d4762c38a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.172413 Jul 11 15:51:47.620534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 118/251] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:47.732404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:47.733511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:47.739993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.740509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:47.741256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:47.741712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:48.022957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:48.031334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-229c525b-47bd-45bd-b3fb-7b9686e9a54d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.302983 Jul 11 15:51:48.031915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 134/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:47 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:48.543943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:48.545093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:48.547539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:48.553276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:48.553731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:48.554486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:48.554927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:48.575078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:48.638334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:48.639520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:48.646289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:48.646732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:48.647520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:48.647944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:48.836231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:48.845064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:48.846674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:48.847877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-682c5c3c-74b8-4a78-8db3-ce466c468d3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.213683 Jul 11 15:51:48.848516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 135/253] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:48.873468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:48.881370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-99ed2ebc-dcc8-4179-80b3-3dca99d89f1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.341316 Jul 11 15:51:48.881921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 119/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:48 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:49.055282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:49.056193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:49.064415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.064860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:49.065617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.066041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:49.201423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:49.209865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ed725737-2f96-49ec-acfa-a4e2c344d224 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.161291 Jul 11 15:51:49.210466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 136/255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:49 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:49.866641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:49.867951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:49.876315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.876721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:49.877486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.878098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:49.900133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:49.902159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:49.910974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.911719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:49.913436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:49.914187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:50.134046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:50.138440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:50.142697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:50.143091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:50.144810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:50.146169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-28d2e6de-cced-4f02-a2db-e56eec4ec889 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1406 microversion: 2.20 time: 0.283713 Jul 11 15:51:50.146929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 120/256] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:51:50.149544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af67eb6f-2941-45a0-a928-2361137707a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.254925 Jul 11 15:51:50.150358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 137/257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:49 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:50.227936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:50.228626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:50.235173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:50.235684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:50.236621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:50.237074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:50.382350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:50.390283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0fdaefe-c22d-4156-a53c-14a1cabecd23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.166671 Jul 11 15:51:50.390859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 121/258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:50 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:51.166381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:51.172390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:51.173002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:51.176996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:51.187320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.187766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.188634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.189062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.190008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.192434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.192996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.193443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.426650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:51.429309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:51.435561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c8207377-1a1a-49c0-93a0-1f239eaf36be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.267562 Jul 11 15:51:51.439525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:51.440752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 122/259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:51 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:51.441131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:51.442421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93721d61-eff1-44fa-b2f3-f3f4a389ffe6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1598 microversion: 2.20 time: 0.279861 Jul 11 15:51:51.442971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 138/260] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:51:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1598 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:51:51.447444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:51.448054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:51.454746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.455577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.456691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.457271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.462432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:51.463013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:51.469492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.470030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.470868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:51.471495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:51.586935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-812ddc5c-4d66-47cd-8b43-d85331a89f2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129808 Jul 11 15:51:51.587522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 139/261] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 11 15:51:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:51:51.639391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:51.651173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c885884f-850f-4401-a1b1-6d9075c44146 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.208880 Jul 11 15:51:51.652173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 123/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:51 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:52.466548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:52.467376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:52.474674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:52.475511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:52.476282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:52.477071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:52.649499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:52.658140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2794fcb6-28e6-4b96-a86c-ae6e5abbc965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.196530 Jul 11 15:51:52.659657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 140/263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:52 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:52.670571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:52.671706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:52.681091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:52.682143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:52.689949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:52.698373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:52.891296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-5619bd68-93a4-4f82-86e3-4749595bb3c3 req-47855cd2-208a-4a4c-bfc2-d59e15013b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:51:52.903727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5619bd68-93a4-4f82-86e3-4749595bb3c3 req-47855cd2-208a-4a4c-bfc2-d59e15013b94 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:52.907793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-5619bd68-93a4-4f82-86e3-4749595bb3c3 req-47855cd2-208a-4a4c-bfc2-d59e15013b94 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:52.935810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:52.946749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-5619bd68-93a4-4f82-86e3-4749595bb3c3 req-47855cd2-208a-4a4c-bfc2-d59e15013b94 service nova] Creating event network-changed:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 15:51:52.951663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c48cb08-2c9e-48e0-b9c6-3a19aa249b81 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.285801 Jul 11 15:51:52.952518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 124/264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:52 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:52.965216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-5619bd68-93a4-4f82-86e3-4749595bb3c3 req-47855cd2-208a-4a4c-bfc2-d59e15013b94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077770 Jul 11 15:51:52.965842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 141/265] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:51:53.680690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:53.681471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:53.699189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:53.701416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:53.704970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:53.705438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:53.896507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:53.905010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-68eac529-ed78-4090-bdb6-4f42c974bd70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.232146 Jul 11 15:51:53.906067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 125/266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:53 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:53.978673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:53.981677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:53.997926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:53.998371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:53.999143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:53.999571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:54.153078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:54.164043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-842f9220-1589-4929-bef3-14332dfbb0c8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.194939 Jul 11 15:51:54.165158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 142/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:53 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:54.923288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:54.923903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:54.930697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:54.931140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:54.931971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:54.932431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:55.064280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:55.071981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30d0eeb4-d670-4ba2-9a45-be61795eb5e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.152765 Jul 11 15:51:55.072614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 126/268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:54 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:51:55.184617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:55.185250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:55.192721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:55.193168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:55.193941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:55.194372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:55.353903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:55.362657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-77f71229-13b0-4878-a9f9-1cc750806d0d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.183259 Jul 11 15:51:55.363271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 143/269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:55 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:56.089532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:56.090281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:56.100135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:56.100608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:56.101542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:56.102473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:56.261523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:56.269788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5be4fef-30d5-4df0-a7d4-c3c80677a941 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.184129 Jul 11 15:51:56.270453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 127/270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:56 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:56.380702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:56.381335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:56.384663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=4 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:56.389040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:56.390027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:56.390956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:56.391542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:56.551826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:56.562049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8e9189d6-e2c8-48cf-bfe8-c9bba2874eaf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.185822 Jul 11 15:51:56.573504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 144/271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:56 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:57.293102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:57.294591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:57.302237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:57.303460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:57.304248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:57.305240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:57.477239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:57.486301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-db4d6962-0756-43d2-8293-993ddea3dcf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.197149 Jul 11 15:51:57.487457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 128/272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:57 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:57.582022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:57.582654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:57.589520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:57.589965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:57.590736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:57.591173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:57.722742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:57.730810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-388ea42f-606e-4d31-8815-4ec8d29f5028 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.152786 Jul 11 15:51:57.731430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 145/273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:57 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:58.503296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:58.503910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:58.510322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:58.510761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:58.511707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:58.512136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:58.663394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:58.677252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-176f0e61-51b7-4705-a7b8-63c570fce682 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.176336 Jul 11 15:51:58.678415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 129/274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:58 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:58.755689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:58.756740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:58.763758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:58.764205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:58.765566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:58.765566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:58.906496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:58.914654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-71d1e213-07b7-4727-8778-cb67e027cc2a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.169168 Jul 11 15:51:58.915237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 146/275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:58 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:59.694777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:59.695409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:59.702607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:59.703048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:59.704106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:59.704557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:59.842394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:51:59.849810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2b796461-308b-45f1-b757-56e9201a62c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.159108 Jul 11 15:51:59.850391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 130/276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:59 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:51:59.932195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:51:59.932963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:51:59.940949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:59.942106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:51:59.943741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:51:59.944424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:00.082778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:00.091530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-07343204-b53e-413e-87be-7ecb6264794e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.163167 Jul 11 15:52:00.096321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 147/277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:51:59 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:00.868245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:00.868870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:00.876323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:00.876777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:00.877532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:00.877959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:01.019380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:01.027214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62498dc6-2270-4473-a601-c6b27bb21de6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.162944 Jul 11 15:52:01.027778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 131/278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:00 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:01.113336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:01.114161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:01.124336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:01.125090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:01.126348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:01.127071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:01.265943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:01.273935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6afe68b-80ef-46f5-aae7-448c727cf9c7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.167634 Jul 11 15:52:01.274532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 148/279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:01 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:02.047968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:02.049611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:02.057646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:02.058446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:02.059520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:02.060252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:02.194884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:02.202770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b821c36c-51c3-4516-8a3b-6ac57a957379 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.161088 Jul 11 15:52:02.203342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 132/280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:02 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:02.300819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:02.301814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:02.311490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:02.311933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:02.312715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:02.313140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:02.449096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:02.457816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b219fc1c-4bfa-4a51-9549-d965419e291f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.163412 Jul 11 15:52:02.458472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 149/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:02 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:03.222284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:03.223835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:03.232049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:03.232551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:03.233313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:03.233740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:03.375187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:03.382728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bd1c4b47-39f6-4785-bd73-08d060f60987 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.166357 Jul 11 15:52:03.383319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 133/282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:03 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:03.478632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:03.479248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:03.487454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:03.488100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:03.489067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:03.489676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:03.631907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:03.643171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e3577250-9561-4f25-a65d-1dbd4802a006 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.168609 Jul 11 15:52:03.643803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 150/283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:03 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:04.401243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:04.402072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:04.409570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:04.410018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:04.410776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:04.411208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:04.550764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:04.559044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c619f681-0ead-42a2-a68f-18ad0b68bfed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.163101 Jul 11 15:52:04.559691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 134/284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:04 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:04.664562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:04.665208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:04.671790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:04.672249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:04.673045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:04.673475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:04.810748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:04.818992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-19a6c8f6-8892-45e4-9774-19fe380dd4eb tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.158350 Jul 11 15:52:04.819550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 151/285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:04 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:05.580542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:05.581221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:05.588587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:05.589032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:05.589791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:05.590220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:05.837250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:05.837820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:05.844782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:05.845231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:05.845997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:05.846444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:05.983304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:05.991266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57955859-4444-479e-afd7-567bc0b0cefb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.417230 Jul 11 15:52:05.992242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 135/286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:05 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:06.013007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:06.021906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1668af1a-f58a-42e0-a91e-f8a2884d4910 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.189163 Jul 11 15:52:06.022443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 152/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:05 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:07.011224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:07.011790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:07.019573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:07.020031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:07.020798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:07.021231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:07.025228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:07.039240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:07.039809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:07.046636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:07.047155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:07.048048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:07.048584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:07.208729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:07.217177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70197e43-e8ab-4b0b-a7dc-1b4addc9e0ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.211549 Jul 11 15:52:07.217814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 136/288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:07 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:07.227052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:07.237066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dc9ecb1f-b5a1-4c8a-b784-5cf7b409a8c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.201869 Jul 11 15:52:07.237638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 153/289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:07 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:08.235509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:08.236028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:08.242973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:08.243425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:08.244188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:08.244650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:08.255414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:08.255991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:08.262451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:08.262874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:08.263706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:08.264230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:08.438912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:08.446513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-292227d3-38e1-46fb-bf04-0e4f7cc141f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.215949 Jul 11 15:52:08.447092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 137/290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:08 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:08.453162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:08.461917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a7f88a7-33ed-4a83-bb84-98de679babd5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.210496 Jul 11 15:52:08.462487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 154/291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:08 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:09.467793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:09.468381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:09.475323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:09.475793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:09.476586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:09.477011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:09.480226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:09.480884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:09.487733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:09.488179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:09.488982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:09.489413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:09.508168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:09.675524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:09.681309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:09.684457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43af85fd-82c2-419a-9dac-7bd02fcfd76a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.222238 Jul 11 15:52:09.685120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 138/292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:09 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:09.696929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bdfae3e0-d9f8-4aa3-8959-0b4e534debb8 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.220587 Jul 11 15:52:09.697645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 155/293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:09 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:10.702388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:10.703028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:10.710343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:10.710823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:10.711577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:10.712003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:10.714973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:10.715564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:10.722503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:10.723201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:10.724642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:10.725279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:10.921705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:10.925463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:10.929379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d810ae6-6001-443f-aa81-9112c0d5a0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.231166 Jul 11 15:52:10.929952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 139/294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:10 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:10.933530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5a1a932-e369-454e-bc5e-b34b4d11b8a7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1724 microversion: 2.1 time: 0.222904 Jul 11 15:52:10.934086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 156/295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:10 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:11.949049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:11.950866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:11.958446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:11.958446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:11.962711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:11.963154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:11.963981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:11.964421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:11.968592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:11.969038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:11.969975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:11.970399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:12.177773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:12.181907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:12.187895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5474739a-428d-4e86-ae74-a83b348fd632 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.244384 Jul 11 15:52:12.188734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 140/296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:11 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:12.190353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ee1b9d3-2230-4587-a64f-ef14184ac6e6 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1701 microversion: 2.1 time: 0.243196 Jul 11 15:52:12.191075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 157/297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:11 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1701 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:12.207346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05c8325f-38e9-48b2-b131-c07976691169 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:12.214336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05c8325f-38e9-48b2-b131-c07976691169 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:12.214784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05c8325f-38e9-48b2-b131-c07976691169 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:12.275451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05c8325f-38e9-48b2-b131-c07976691169 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Going to try to start instance {{(pid=124241) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 15:52:12.321840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05c8325f-38e9-48b2-b131-c07976691169 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action" status: 202 len: 0 microversion: 2.1 time: 0.118379 Jul 11 15:52:12.322442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 141/298] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:52:12 2022] POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:52:12.330677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:12.331327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:12.337877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:12.338355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:12.339188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:12.339627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:12.485515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:12.493623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fbb04a0-ab2a-4070-a9c0-c59422a1020b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1710 microversion: 2.1 time: 0.166829 Jul 11 15:52:12.494229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 158/299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:12 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:13.202732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-675329919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629573614", "security_groups": [{"name": "tempest-secgroup-smoke-1363668069"}], "block_device_mapping_v2": [{"uuid": "75659b42-21dc-46d1-9215-566a4bd63f97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3e915a0-31c4-49bc-b8c1-6d46cfd20e29"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:13.206850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:13.207959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:13.218146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:13.218893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:13.220470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:13.222413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:13.496083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] validate_networks() for [('c3e915a0-31c4-49bc-b8c1-6d46cfd20e29', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:52:13.558053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:13.568790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ce1c128-f568-497a-bf8c-8004d3fe03de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.366752 Jul 11 15:52:13.569493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 159/300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:13 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:13.583005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:13.583618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:13.590869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:13.591466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:13.592407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:13.592836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:13.883697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:13.892332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c35bb3f5-b826-4cf6-9700-af4911e74b7b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1710 microversion: 2.1 time: 0.313137 Jul 11 15:52:13.893281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 160/301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:13 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1710 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:14.175690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:52:14.176182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:52:14.177137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:52:14.177547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:52:14.178095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:52:14.195324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.196357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:14.197432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.197994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:14.219403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Getting quotas for project 34616afcc7d2411992085fbb829ec4d8. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:14.223858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Getting quotas for user 0c2fbf5d3064479a909e7547a050ef5e and project 34616afcc7d2411992085fbb829ec4d8. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:14.289504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:52:14.292042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75659b42-21dc-46d1-9215-566a4bd63f97',volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:52:14.461042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ce3c44c5-a36c-42c4-b055-a9596dfa5e3d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.263613 Jul 11 15:52:14.462786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 142/302] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:52:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:52:14.471587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6b0e6d8a-0ec2-42ea-b61e-00196397d64a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:14.472190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6b0e6d8a-0ec2-42ea-b61e-00196397d64a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:14.532352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6b0e6d8a-0ec2-42ea-b61e-00196397d64a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:14.540098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6b0e6d8a-0ec2-42ea-b61e-00196397d64a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1094 microversion: 2.1 time: 0.072352 Jul 11 15:52:14.540973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 161/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:14.587985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:14.588984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:14.599128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.599578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:14.600367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.600801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:14.804053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:14.820557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-abe5aa58-98a9-4e6d-80cc-6193df5ed042 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.238974 Jul 11 15:52:14.821353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 143/304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:14 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:14.910183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:14.910892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:14.917604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.918137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:14.919020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:14.920604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:15.115243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:15.123888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-acfade40-51d6-4ed8-a552-41a3fa32a441 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1710 microversion: 2.1 time: 0.217676 Jul 11 15:52:15.124508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 162/305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:14 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:15.557609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:15.558233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:15.572435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:15.572892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:15.573662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:15.574094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:15.647496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:15.656022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf50d379-48e7-45fc-8071-a9edb9bb465a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1192 microversion: 2.1 time: 0.102563 Jul 11 15:52:15.656668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 144/306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:15.838413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:15.839111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:15.845469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:15.845922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:15.846693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:15.847131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:15.980415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:15.988305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2dbb88f2-e58f-4c51-bc03-865e58ac4cad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1502 microversion: 2.1 time: 0.154635 Jul 11 15:52:15.988891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 163/307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:15 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:16.004804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5e1483c-fdb1-468b-9bad-ff4e3299ae57"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:16.005945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:16.012067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.012560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.013404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.013842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.037261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] HTTP exception thrown: Cannot 'attach_volume' instance 2901472e-529a-4ef6-a35e-0677479d2964 while it is in vm_state rescued Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Request method failure captured: Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/os-volume_attachments HTTP/1.1 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 74 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEag6YXw0V8Ns2rYUS4MeF5L8t83JnP0MsleHCR6D95kVRhHreNBQ2_BQpw0h4naIrMpOyCFpfi_eQSoa-7F1SIzfTJCnYoWWQNuLVUtmHrA0vmzox_gC7uTtHMhfqz1gN3OnXgB2LoeW5lb8Pd6sH3wDFSV1uAVfGMQhz8vVWt-eDo Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:52:16.039188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c230554e8a34a7086e433e797360e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c230554e8a34a7086e433e797360e28"}]}] Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 9d44f1f434534cc0b373943d48d672df Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {"volumeAttachment": {"volumeId": "e5e1483c-fdb1-468b-9bad-ff4e3299ae57"}} Jul 11 15:52:16.040766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Cannot 'attach_volume' instance 2901472e-529a-4ef6-a35e-0677479d2964 while it is in vm_state rescued Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'server_id': '2901472e-529a-4ef6-a35e-0677479d2964', 'body': {'volumeAttachment': {'volumeId': 'e5e1483c-fdb1-468b-9bad-ff4e3299ae57'}}} Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2901472e-529a-4ef6-a35e-0677479d2964 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:52:16.041565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2901472e-529a-4ef6-a35e-0677479d2964 while it is in vm_state rescued Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:52:16.042713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2901472e-529a-4ef6-a35e-0677479d2964 while it is in vm_state rescued Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Returning 409 to user: Cannot 'attach_volume' instance 2901472e-529a-4ef6-a35e-0677479d2964 while it is in vm_state rescued {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-23295231-918f-452b-90fa-93facfad6736 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039885 Jul 11 15:52:16.043811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 145/308] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:52:15 2022] POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 15:52:16.050881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:16.051522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:16.057876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.058316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.059088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.059521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.127330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a9a84d0e-36e9-4812-912b-d826ea52a49b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/action" status: 202 len: 0 microversion: 2.1 time: 0.080984 Jul 11 15:52:16.127981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 164/309] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:52:16 2022] POST /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:52:16.136990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:16.138562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:16.141604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:16.142297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:16.148651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.149158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.149629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.150087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.150205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.150601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.150852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.151598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.489133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:16.489581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:16.504449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b5e789b-c34a-46f2-9725-5dd2d830b92c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1714 microversion: 2.1 time: 0.366864 Jul 11 15:52:16.511489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 165/310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:16 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1714 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:16.513695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-80f430d1-c4ba-4a0d-b58d-b4ffdaf40df9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1510 microversion: 2.1 time: 0.380790 Jul 11 15:52:16.514557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 146/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:16 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:16.674384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:16.675005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:16.681517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.682232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:16.683303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:16.684090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:17.012094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:17.025740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-06742f0c-7c82-48f3-a720-504387962586 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1210 microversion: 2.1 time: 0.352484 Jul 11 15:52:17.027417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 166/312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:17.389823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1073953902", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:17.476561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] validate_networks() for None {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:52:17.533473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:17.534410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:17.537452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=70 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:17.543348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:17.543811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:17.544673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:17.545115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:17.808998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:17.817173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5ee65e8-84ca-41c0-b3cf-dc35eefb82c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1510 microversion: 2.1 time: 0.290143 Jul 11 15:52:17.817905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 167/313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:17 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:17.839461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:52:17.839888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:52:17.840458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:52:17.840868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:52:17.841502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:52:17.850815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:17.851341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:17.852031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:17.852503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:17.869415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Getting quotas for project e1d330b93b494e66a42c8179fe479b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:17.873921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Getting quotas for user f21e115769624d058954f373ecee906d and project e1d330b93b494e66a42c8179fe479b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:17.885970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:52:17.888280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:52:17.936502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dbca59a8-63ce-4bd6-8aab-27b4224d9ac3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550675 Jul 11 15:52:17.937345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 147/314] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:52:17.948023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f06f5ea4-696b-46c1-ac7b-bf99947e101a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:17.948672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f06f5ea4-696b-46c1-ac7b-bf99947e101a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:18.003000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f06f5ea4-696b-46c1-ac7b-bf99947e101a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:18.011764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f06f5ea4-696b-46c1-ac7b-bf99947e101a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1215 microversion: 2.1 time: 0.068239 Jul 11 15:52:18.012698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 168/315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:17 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:18.043776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:18.044747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:18.051906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:18.052639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:18.053405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:18.053836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:18.202845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:18.212356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-704e0701-0bdb-42ad-9474-0eb20470a29b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.172293 Jul 11 15:52:18.212848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 148/316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:18.836425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:18.837466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:18.844159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:18.844766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:18.845613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:18.846244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.030323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:19.031459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:19.037031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:19.071574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:19.077872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.078608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:19.079162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:19.081270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.097883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ae8475d-2dea-4925-ada3-70129647b874 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1510 microversion: 2.1 time: 0.265947 Jul 11 15:52:19.111955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 169/317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:18 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:19.230210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:19.231191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:19.243465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:19.244370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.245838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:19.246554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.257393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:19.271408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f19c21b6-4a5e-43bb-804a-d6b98f7cbf32 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1211 microversion: 2.1 time: 0.245679 Jul 11 15:52:19.278407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 149/318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:19 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1211 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:19.287979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-37a6d0ad-51e7-424e-8a79-7a80b423d258 req-e091d461-41e6-47c1-b445-5a359b1b582a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc150a1-4fb4-44a9-8bbc-641cb207d92f", "tag": "49cb686e-832f-4279-9d17-2a934de0cd7e"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:19.302779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-37a6d0ad-51e7-424e-8a79-7a80b423d258 req-e091d461-41e6-47c1-b445-5a359b1b582a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:19.303696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-37a6d0ad-51e7-424e-8a79-7a80b423d258 req-e091d461-41e6-47c1-b445-5a359b1b582a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:19.318806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-37a6d0ad-51e7-424e-8a79-7a80b423d258 req-e091d461-41e6-47c1-b445-5a359b1b582a service nova] Creating event network-changed:49cb686e-832f-4279-9d17-2a934de0cd7e for instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f on hv-cinder-79760 Jul 11 15:52:19.328466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-37a6d0ad-51e7-424e-8a79-7a80b423d258 req-e091d461-41e6-47c1-b445-5a359b1b582a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047299 Jul 11 15:52:19.330707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 150/319] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:19.485465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:19.494185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-afa7e1c9-aa31-47f9-8feb-47dfceca9a94 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.268944 Jul 11 15:52:19.495136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 170/320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:20.119904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:20.120900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:20.130337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.131080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.132318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.133052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.276767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:20.285977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95d06c98-4060-4699-afdc-99108067cf1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1516 microversion: 2.1 time: 0.170269 Jul 11 15:52:20.286681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 151/321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:20 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:20.291000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:20.291611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:20.298339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.298954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.299938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.300553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.378770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:20.391211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f3603c46-f910-4090-843b-9251d1faf38d tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1273 microversion: 2.1 time: 0.104468 Jul 11 15:52:20.392337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 171/322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:20 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:20.511281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:20.511844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:20.523043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.523780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.524775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:20.525361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:20.909135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:20.917560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f218c163-bedb-48bb-bbc9-635295254945 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.410223 Jul 11 15:52:20.918781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 152/323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:21.409593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:21.410209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:21.416416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:21.416837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:21.417781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:21.418201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:21.555968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:21.566065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05491dfa-248a-4a80-959c-8024053c6447 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.160586 Jul 11 15:52:21.566914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 172/324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:21 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:21.723569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-725c455b-aafc-4926-bf95-04fc4a6bef8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: .version_select at 0x7f20b3797dc0>, body: {"keypair": {"name": "tempest-keypair-808459836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6nzWuK2JbAJgKQmuonD/bjMednZaqJeiCcp1ffFWqTV3UyfiFaNKKSuSoQVotN4rgCpZkMEOT0wVYm1d5lIC69oWm3guxmmpTT5w2ve7kldQlrLXfUiKujLgvImDVxjQ=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:21.771730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-725c455b-aafc-4926-bf95-04fc4a6bef8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for project 5c230554e8a34a7086e433e797360e28. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:21.778145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-725c455b-aafc-4926-bf95-04fc4a6bef8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for user 9d44f1f434534cc0b373943d48d672df and project 5c230554e8a34a7086e433e797360e28. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:21.815693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-725c455b-aafc-4926-bf95-04fc4a6bef8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095190 Jul 11 15:52:21.821152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 153/325] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 15:52:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:21.936624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:21.937505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:21.943826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:21.944538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:21.945465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:21.946051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:21.950496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:22.239145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:22.257456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-acd00ca5-3458-42e7-b179-b8b4f4e3a9aa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.326251 Jul 11 15:52:22.285551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 173/326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:22.583597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:22.584667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:22.594238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:22.596506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:22.598385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:22.600116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:22.723846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-21d315bf-6014-43df-976a-090163a61796 req-7cece48b-5d77-439a-8a84-370544e1d938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df3fdec-aca4-4ed2-b596-99039daaf736", "tag": "2328beaf-81a9-42bd-bf54-d0aeaca31d6b"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:22.775003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-21d315bf-6014-43df-976a-090163a61796 req-7cece48b-5d77-439a-8a84-370544e1d938 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:22.775450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-21d315bf-6014-43df-976a-090163a61796 req-7cece48b-5d77-439a-8a84-370544e1d938 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:22.800077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-21d315bf-6014-43df-976a-090163a61796 req-7cece48b-5d77-439a-8a84-370544e1d938 service nova] Creating event network-changed:2328beaf-81a9-42bd-bf54-d0aeaca31d6b for instance 4df3fdec-aca4-4ed2-b596-99039daaf736 on hv-cinder-79760 Jul 11 15:52:22.809777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-21d315bf-6014-43df-976a-090163a61796 req-7cece48b-5d77-439a-8a84-370544e1d938 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103963 Jul 11 15:52:22.810779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 174/327] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:23.094703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:23.106755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3939b256-fc2d-4a75-bf43-5003d9ebafbb tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.527436 Jul 11 15:52:23.118954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 154/328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:22 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:23.277146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:23.277872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:23.290650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:23.295746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:23.296834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:23.298811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:23.556716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:23.569266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3aef6474-de94-40f5-90e4-61bcfc128a07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.297488 Jul 11 15:52:23.570971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 175/329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:24.125775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:24.126505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:24.142000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:24.145304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:24.146266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:24.156490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:24.210190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:24.352165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1227589404", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f70e4607-6877-45c5-bd0c-dc82275e0108"}], "security_groups": [{"name": "tempest-securitygroup--1061677816"}], "key_name": "tempest-keypair-808459836", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:24.370952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:24.379519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-46ef88de-b915-4732-817b-b482e818e119 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.258987 Jul 11 15:52:24.380123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 155/330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:24 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:24.475058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] validate_networks() for [('f70e4607-6877-45c5-bd0c-dc82275e0108', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:52:24.588355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:24.591118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:24.603346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:24.604214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:24.605273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:24.605714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:24.853277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:24.869216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2b9c47b8-3387-44d2-89a4-5c53cb07b5e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.284892 Jul 11 15:52:24.869811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 156/331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:25.034244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:52:25.035163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:52:25.036164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:52:25.037254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:52:25.038388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:52:25.055344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.067353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:25.068957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.069693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:25.099414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:25.107052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Getting quotas for user 9d44f1f434534cc0b373943d48d672df and project 5c230554e8a34a7086e433e797360e28. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:25.143452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:52:25.150188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:52:25.246686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c6960227-7680-4d5a-80cd-5f1570089e5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.895080 Jul 11 15:52:25.249046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 176/332] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:52:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:52:25.267256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d8d58853-6c22-4d70-8032-6c886a1251b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:25.267874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d8d58853-6c22-4d70-8032-6c886a1251b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:25.358804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d8d58853-6c22-4d70-8032-6c886a1251b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:25.368677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d8d58853-6c22-4d70-8032-6c886a1251b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1245 microversion: 2.1 time: 0.111753 Jul 11 15:52:25.369735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 157/333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:25.396565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:25.397176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:25.404261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.404724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:25.405485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.405914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:25.635785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:25.647805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-33ecb0f2-6331-42c2-ad4a-960dd88a5eaf tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.253614 Jul 11 15:52:25.650388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 177/334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:25 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:25.886961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:25.887591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:25.894261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.894969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:25.895913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:25.896689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:26.256950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:26.267598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-585463c3-8d6b-4920-8bd1-35be668acbbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.384315 Jul 11 15:52:26.269382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 158/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:26.386994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:26.387662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:26.394127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:26.394889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:26.396050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:26.397028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:26.590052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:26.602240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c5373310-7910-41ca-9eb2-5b4b5e6248c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1249 microversion: 2.1 time: 0.219012 Jul 11 15:52:26.602828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 178/336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1249 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:26.672264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:26.674028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:26.707997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:26.709712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:26.710838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:26.712190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:26.980118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:26.997923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8638a014-5fb1-4337-a1c0-c5ec3998f234 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.334553 Jul 11 15:52:26.999834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 159/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:26 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:27.285822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:27.286690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:27.300113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:27.300862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:27.302976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:27.306938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:27.619084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:27.619615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:27.634779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:27.635223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:27.637035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:27.637338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:27.859986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:27.994409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:28.006821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4ead54a-d1b2-4d10-841a-6dfd83044b18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1303 microversion: 2.1 time: 0.391462 Jul 11 15:52:28.009689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 160/338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1303 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:28.023098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-523262a5-910b-4363-9647-aff7fe5190cb req-2fd70b98-f988-4d8c-8751-7237fe7ef55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df3fdec-aca4-4ed2-b596-99039daaf736", "name": "network-vif-plugged", "status": "completed", "tag": "2328beaf-81a9-42bd-bf54-d0aeaca31d6b"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:28.043544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-523262a5-910b-4363-9647-aff7fe5190cb req-2fd70b98-f988-4d8c-8751-7237fe7ef55e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:28.048083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-523262a5-910b-4363-9647-aff7fe5190cb req-2fd70b98-f988-4d8c-8751-7237fe7ef55e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:28.079400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-523262a5-910b-4363-9647-aff7fe5190cb req-2fd70b98-f988-4d8c-8751-7237fe7ef55e service nova] Creating event network-vif-plugged:2328beaf-81a9-42bd-bf54-d0aeaca31d6b for instance 4df3fdec-aca4-4ed2-b596-99039daaf736 on hv-cinder-79760 Jul 11 15:52:28.098979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-523262a5-910b-4363-9647-aff7fe5190cb req-2fd70b98-f988-4d8c-8751-7237fe7ef55e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087631 Jul 11 15:52:28.101842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 161/339] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:28.118572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:28.121059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:28.142938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:28.143400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:28.144188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:28.150951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:28.204580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:28.214927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c49a5b85-b748-446d-bc45-3dd2855f140d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.933269 Jul 11 15:52:28.215520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 179/340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:28.490983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:28.518398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6196fd50-6c7a-4b88-bc38-38af6e749a13 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.398993 Jul 11 15:52:28.519972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 162/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:28 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:29.024631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:29.025262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:29.034503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.038016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.039484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.041003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.245620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:29.247722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:29.257538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.258394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.259507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.260099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.352774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:29.365196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54713379-a986-4130-abfe-095a8c75fd3a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.344224 Jul 11 15:52:29.366510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 180/342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:29.537545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:29.538434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:29.545895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.546583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.547570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.548143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.555216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:29.569149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c169408-f415-4095-aa79-b2a44b83064e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.340891 Jul 11 15:52:29.569915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 163/343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:29.761157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-96f3e05a-7e0d-48e8-bb3a-ac9af2617060 req-b6aa39d4-f547-4437-8a8c-fdc3c65c7cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:29.774642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-96f3e05a-7e0d-48e8-bb3a-ac9af2617060 req-b6aa39d4-f547-4437-8a8c-fdc3c65c7cad service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:29.775382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-96f3e05a-7e0d-48e8-bb3a-ac9af2617060 req-b6aa39d4-f547-4437-8a8c-fdc3c65c7cad service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:29.804777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-96f3e05a-7e0d-48e8-bb3a-ac9af2617060 req-b6aa39d4-f547-4437-8a8c-fdc3c65c7cad service nova] Creating event network-changed:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 15:52:29.811867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-96f3e05a-7e0d-48e8-bb3a-ac9af2617060 req-b6aa39d4-f547-4437-8a8c-fdc3c65c7cad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054341 Jul 11 15:52:29.813392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 164/344] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:29.844187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:29.856067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-06cc0dd0-4a8c-4a0e-8665-882b1c881a30 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1315 microversion: 2.1 time: 0.321891 Jul 11 15:52:29.857317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 181/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:29 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:30.383790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:30.384595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:30.392130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.393952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.395014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.396094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.586709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:30.588095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:30.595505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.596378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.597397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.598089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.810705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:30.822029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19b74ad7-8f1f-4546-b0be-dbaf767213ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.442837 Jul 11 15:52:30.823247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 165/346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:30.872269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:30.873196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:30.879389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.879826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.880634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:30.881230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:30.935467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:30.947807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-419b9233-468a-4c37-86c7-60faaf824fc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.365397 Jul 11 15:52:30.949037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 182/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:31.348048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:31.352687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-4c1e2b7c-71a6-4f02-9fcc-e6896b49b56d req-8ed30eb5-1e9a-4179-a017-05608eec4f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc150a1-4fb4-44a9-8bbc-641cb207d92f", "name": "network-vif-plugged", "status": "completed", "tag": "49cb686e-832f-4279-9d17-2a934de0cd7e"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:31.357019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9e395506-8325-43ab-a5fe-408cc0bf60b7 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1465 microversion: 2.1 time: 0.488080 Jul 11 15:52:31.357504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 166/348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:30 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1465 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:31.365267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-4c1e2b7c-71a6-4f02-9fcc-e6896b49b56d req-8ed30eb5-1e9a-4179-a017-05608eec4f37 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.365267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-4c1e2b7c-71a6-4f02-9fcc-e6896b49b56d req-8ed30eb5-1e9a-4179-a017-05608eec4f37 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.377673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-4c1e2b7c-71a6-4f02-9fcc-e6896b49b56d req-8ed30eb5-1e9a-4179-a017-05608eec4f37 service nova] Creating event network-vif-plugged:49cb686e-832f-4279-9d17-2a934de0cd7e for instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f on hv-cinder-79760 Jul 11 15:52:31.389002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-4c1e2b7c-71a6-4f02-9fcc-e6896b49b56d req-8ed30eb5-1e9a-4179-a017-05608eec4f37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038582 Jul 11 15:52:31.404936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 183/349] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:31.409245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:31.409875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:31.421771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.422349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.423677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.426593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.487679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 15:52:31.624263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c27981f2-5aa6-4fb4-bd55-68a756b967d0 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 204 len: 0 microversion: 2.1 time: 0.219638 Jul 11 15:52:31.625181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 167/350] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:52:31 2022] DELETE /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 15:52:31.634030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:31.634752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:31.643106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.643574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.644379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.644837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.840023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:31.841251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:31.848243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.848967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.850204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.850642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.881229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:31.889636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d4ba7f4c-6efb-4fe3-9bbe-1b8819f6d572 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1471 microversion: 2.1 time: 0.259853 Jul 11 15:52:31.890587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 184/351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:31 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:31.966287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:31.966897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:31.974017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.974463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.975231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:31.975659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:31.995289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:32.005171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-533f92a0-a2a8-47d3-8418-9abd015fc17e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.168557 Jul 11 15:52:32.014244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 168/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:32.137063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:32.146377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-21dbaa5a-bae2-4552-9794-2ae3749851e8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.183689 Jul 11 15:52:32.147610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 185/353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:32.907252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:32.908031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:32.919566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:32.920505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:32.921281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:32.921730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:33.032249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:33.033657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:33.071305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:33.072906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:33.074679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:33.076887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:33.187842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:33.206764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f709172-ec47-44ea-bc4a-11cf0bc79f3a tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1471 microversion: 2.1 time: 0.303441 Jul 11 15:52:33.207352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 169/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:32 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:33.223727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:33.225067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:33.240738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:33.241454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:33.242443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:33.244000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:33.324751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:33.336248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-34546667-00c2-43f8-8b02-6f948e61562b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.310423 Jul 11 15:52:33.345692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 186/355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:33.452271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:33.461353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-955a717c-7a70-43d9-a895-d74091eb9790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.251345 Jul 11 15:52:33.461935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 170/356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:34.224827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:34.226231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:34.234914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.235785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.236627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.237264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.353527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:34.354679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:34.361408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.362100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.363113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.363698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.463933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:34.477734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2d957155-0592-47a3-8202-cde099fe23f3 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1471 microversion: 2.1 time: 0.256855 Jul 11 15:52:34.483165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 187/357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:34 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:34.491937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:34.492776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:34.499908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.500633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.501574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.502157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:34.563518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:34.571544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b8e12c7-b42b-4f88-a706-ac07f69452a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.222325 Jul 11 15:52:34.588074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 171/358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:34.672452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:34.681237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b9f57e1f-a61f-4ee9-bb83-bf6ccbc6d7d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1266 microversion: 2.1 time: 0.196711 Jul 11 15:52:34.691975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 188/359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:34.943823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-4eea1742-7074-433a-9674-1cfbc865620c req-45d490c5-8971-4b1a-9079-0e30270f9a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df3fdec-aca4-4ed2-b596-99039daaf736", "name": "network-vif-deleted", "tag": "2328beaf-81a9-42bd-bf54-d0aeaca31d6b"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:34.954314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4eea1742-7074-433a-9674-1cfbc865620c req-45d490c5-8971-4b1a-9079-0e30270f9a49 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:34.956175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4eea1742-7074-433a-9674-1cfbc865620c req-45d490c5-8971-4b1a-9079-0e30270f9a49 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.004197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-4eea1742-7074-433a-9674-1cfbc865620c req-45d490c5-8971-4b1a-9079-0e30270f9a49 service nova] Creating event network-vif-deleted:2328beaf-81a9-42bd-bf54-d0aeaca31d6b for instance 4df3fdec-aca4-4ed2-b596-99039daaf736 on hv-cinder-79760 Jul 11 15:52:35.010598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-4eea1742-7074-433a-9674-1cfbc865620c req-45d490c5-8971-4b1a-9079-0e30270f9a49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070718 Jul 11 15:52:35.011473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 172/360] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:35.283156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-9eeb3e1b-219f-4b9b-b39f-5dead930a702 req-70656cc1-bac2-4534-bb26-69ff3a74d4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "name": "network-vif-plugged", "status": "completed", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:35.311749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:35.311749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=10 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:35.311749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9eeb3e1b-219f-4b9b-b39f-5dead930a702 req-70656cc1-bac2-4534-bb26-69ff3a74d4fe service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.311749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9eeb3e1b-219f-4b9b-b39f-5dead930a702 req-70656cc1-bac2-4534-bb26-69ff3a74d4fe service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.315969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-9eeb3e1b-219f-4b9b-b39f-5dead930a702 req-70656cc1-bac2-4534-bb26-69ff3a74d4fe service nova] Creating event network-vif-plugged:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 15:52:35.329513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-9eeb3e1b-219f-4b9b-b39f-5dead930a702 req-70656cc1-bac2-4534-bb26-69ff3a74d4fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049850 Jul 11 15:52:35.331184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 189/361] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:52:35.493743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=18 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:35.498630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:35.499816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:35.508173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.508835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.509773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.510295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.516013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:35.549584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.549584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.549584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lazy-loading 'fault' on Instance uuid 4df3fdec-aca4-4ed2-b596-99039daaf736 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:52:35.591186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:35.591901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:35.598505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.598861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.600009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.600103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.600736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21e115769624d058954f373ecee906d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d330b93b494e66a42c8179fe479b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:35.610694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-de5d6a1b-8891-4eda-bafa-6ff0162a1acd tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 200 len: 1305 microversion: 2.1 time: 0.118747 Jul 11 15:52:35.611289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 173/362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:35 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:35.709054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:35.710098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:35.724486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.726513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.729237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:35.729984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:35.840306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:35.851650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-86de9775-fe68-4071-8081-c69f334772da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.265415 Jul 11 15:52:35.858392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 190/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:35.986965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:35.997841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1f19219a-eecd-4db4-abb4-464541096216 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1453 microversion: 2.1 time: 0.301227 Jul 11 15:52:35.999322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 174/364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1453 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:36.018427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:36.026146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:36.042968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.043727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.044628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.049766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.292322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:36.302224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f2939ef-bda8-45ca-a922-c8cf63473af6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1453 microversion: 2.1 time: 0.290768 Jul 11 15:52:36.303076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 191/365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:36.628187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:36.629451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] [instance: 4df3fdec-aca4-4ed2-b596-99039daaf736] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:36.637512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.638341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.639358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.640004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.654466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] HTTP exception thrown: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Request method failure captured: Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 HTTP/1.1 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEcvId_UAvX9JYSCauXJoRNrLW7cCMCFprrNA2Tn2GqXiX2vzOrsXru6tg9fRRsKpxtLN_-upvuaFqF6hSbH1tI_Xp0tvXwr93nMRT9R6nhNwAxwJKul0080RMkR7IOcEuiiSLZ8IIayPCCODn_ryJwoz9Uq0uGMbebcURzO4QRtI1Q Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: e1d330b93b494e66a42c8179fe479b11 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesNegativeTest-595761363 Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 15:52:36.656791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1d330b93b494e66a42c8179fe479b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1d330b93b494e66a42c8179fe479b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1d330b93b494e66a42c8179fe479b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1d330b93b494e66a42c8179fe479b11"}]}] Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesNegativeTest-595761363 Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: e1d330b93b494e66a42c8179fe479b11 Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesNegativeTest-595761363 Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesNegativeTest-595761363-project Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: f21e115769624d058954f373ecee906d Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesNegativeTest-595761363-project Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. Jul 11 15:52:36.658184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '4df3fdec-aca4-4ed2-b596-99039daaf736'} Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:52:36.658958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. Jul 11 15:52:36.660181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 15:52:36.665207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] Returning 404 to user: Instance 4df3fdec-aca4-4ed2-b596-99039daaf736 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:52:36.666444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf00fc20-6291-4b38-b976-5217d2794312 tempest-VolumesNegativeTest-595761363 tempest-VolumesNegativeTest-595761363-project] 10.222.0.26 "GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736" status: 404 len: 111 microversion: 2.1 time: 0.042291 Jul 11 15:52:36.677390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 175/366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:36 2022] GET /compute/v2.1/servers/4df3fdec-aca4-4ed2-b596-99039daaf736 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:36.870046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:36.870723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:36.888530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.892330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.898407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:36.899002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:36.970027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:37.131765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:37.140284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-62b3179e-a278-47eb-ac51-5ca1e545103e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.274819 Jul 11 15:52:37.144447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 192/367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:38.132374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:38.135953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:38.154063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:38.154733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:38.158764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:38.159229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:38.160888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:38.161495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:38.181990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:38.182443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:38.198576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:38.199170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:38.219743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-13c5c5c4-d5e5-484f-92e5-d78b91615da9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/ips" status: 200 len: 152 microversion: 2.20 time: 0.094132 Jul 11 15:52:38.220370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 176/368] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 11 15:52:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:52:38.480001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:38.491595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-74d66f4b-d9b6-483e-8901-6f633140a3e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1371 microversion: 2.1 time: 0.335516 Jul 11 15:52:38.504756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 193/369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:39.510204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:39.510804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:39.526991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:39.527436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:39.528347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:39.528773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:39.819594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:39.843600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6880d993-07be-4176-95e0-ceb2a8ec3631 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1565 microversion: 2.1 time: 0.329618 Jul 11 15:52:39.843600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 177/370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1565 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:39.858435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:39.860666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:39.873885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:39.876186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:39.877332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:39.879573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:40.040505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f8764fbf-9c80-4906-811b-20eeb9a41dd5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187660 Jul 11 15:52:40.047984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 194/371] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 15:52:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:40.069383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-592cf834-3294-480e-bbd6-bedef5982481 req-f4b171ad-c216-4989-bf63-72a106e1b3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc150a1-4fb4-44a9-8bbc-641cb207d92f", "tag": "49cb686e-832f-4279-9d17-2a934de0cd7e"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:40.080629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-592cf834-3294-480e-bbd6-bedef5982481 req-f4b171ad-c216-4989-bf63-72a106e1b3e0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:40.081319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-592cf834-3294-480e-bbd6-bedef5982481 req-f4b171ad-c216-4989-bf63-72a106e1b3e0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:40.096168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-592cf834-3294-480e-bbd6-bedef5982481 req-f4b171ad-c216-4989-bf63-72a106e1b3e0 service nova] Creating event network-changed:49cb686e-832f-4279-9d17-2a934de0cd7e for instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f on hv-cinder-79760 Jul 11 15:52:40.102129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-592cf834-3294-480e-bbd6-bedef5982481 req-f4b171ad-c216-4989-bf63-72a106e1b3e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037850 Jul 11 15:52:40.108160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 178/372] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:41.209899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:41.210809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:41.222736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:41.227920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:41.229378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:41.251827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:41.345085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lazy-loading 'flavor' on Instance uuid 4a6ea184-76c8-4450-97c5-b81cbc8aacbd {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:52:41.828995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7f7730b-4f50-4cb3-ad32-af09ad671794 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action" status: 202 len: 0 microversion: 2.20 time: 0.623771 Jul 11 15:52:41.835333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 195/373] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 11 15:52:41 2022] POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:52:41.843234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:41.846148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:41.859656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:41.868805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:41.869874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:41.870454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:41.883899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-6d7aa44a-2b2f-47e3-bdcf-c5bce05d2518 req-4d907ccb-d19a-4ac7-a58d-65717c631d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:41.895177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6d7aa44a-2b2f-47e3-bdcf-c5bce05d2518 req-4d907ccb-d19a-4ac7-a58d-65717c631d15 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:41.895792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-6d7aa44a-2b2f-47e3-bdcf-c5bce05d2518 req-4d907ccb-d19a-4ac7-a58d-65717c631d15 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:41.913042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-6d7aa44a-2b2f-47e3-bdcf-c5bce05d2518 req-4d907ccb-d19a-4ac7-a58d-65717c631d15 service nova] Creating event network-changed:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 15:52:41.919702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-6d7aa44a-2b2f-47e3-bdcf-c5bce05d2518 req-4d907ccb-d19a-4ac7-a58d-65717c631d15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Jul 11 15:52:41.921006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 196/374] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:42.133355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:42.142891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:42.144450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:42.145598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-552f4eaf-6469-4c1d-b692-947784bb5ac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.309202 Jul 11 15:52:42.146141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 179/375] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:52:43.163778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:43.164504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:43.176316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:43.177060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:43.178113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:43.179541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:43.407705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:43.429392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:43.435793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:43.437052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9c1d85f4-7416-45e1-8922-fadae03e047e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.277821 Jul 11 15:52:43.438100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 197/376] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:44.455723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:44.457214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:44.467156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:44.467600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:44.481062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:44.481524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:44.689112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:44.698062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:44.699587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:44.700913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-199e236e-7efc-4a24-bbaf-f11e4c013bd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.249488 Jul 11 15:52:44.701457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 180/377] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:45.085561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fa61ddb7-e7a6-40ca-bc8c-629a07314c5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'create', calling method: .version_select at 0x7f20b3482820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1476978995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW86VGP18yGWvNpjVQ3I7SFYfdWtfS5Bqh+8qECa5RtfDh+q9jYg34hKJM3kauM1C2K2UksZsw+Ztr0Z+d+vW+ZJRBDp8G+Xu9+YT0BaoB0fMBP0HSHzpS35LSbaBVg1A=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:45.106619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fa61ddb7-e7a6-40ca-bc8c-629a07314c5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Getting quotas for project e28a535e7b6044daa85fa92c799f6069. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:45.115640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-fa61ddb7-e7a6-40ca-bc8c-629a07314c5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Getting quotas for user 726afc5bae8a405bb182f9ed67122d3c and project e28a535e7b6044daa85fa92c799f6069. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:45.144024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fa61ddb7-e7a6-40ca-bc8c-629a07314c5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.063394 Jul 11 15:52:45.145085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 198/378] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 15:52:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:45.270064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2061946898", "imageRef": "b718ae42-a3e7-4021-add4-267474f46348", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1476978995", "networks": [{"uuid": "6b7b7818-a535-4403-ad19-8fab26713f07"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:45.335880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] validate_networks() for [('6b7b7818-a535-4403-ad19-8fab26713f07', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:52:45.721387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:45.723196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:45.733883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:45.734569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:45.735803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:45.736636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:45.910676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:52:45.911309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:52:45.911766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:52:45.912265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:52:45.912793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:52:45.923636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:45.924444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:45.925623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:45.926059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:45.945444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:45.948314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Getting quotas for project e28a535e7b6044daa85fa92c799f6069. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:45.953058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Getting quotas for user 726afc5bae8a405bb182f9ed67122d3c and project e28a535e7b6044daa85fa92c799f6069. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:45.957681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:45.959604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:45.963163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e690467-a8c4-4c47-acfa-e146aa39306c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.247581 Jul 11 15:52:45.966586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:52:45.967262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 199/379] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:45.969308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b718ae42-a3e7-4021-add4-267474f46348',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:52:45.991027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:46.026069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-241ffeda-95da-415e-97c2-d42f0180f71c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761114 Jul 11 15:52:46.027280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 181/380] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:52:46.038851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d0203198-d728-4bf6-ae42-8e0f981129bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:46.041784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d0203198-d728-4bf6-ae42-8e0f981129bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:46.117896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d0203198-d728-4bf6-ae42-8e0f981129bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:46.127355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d0203198-d728-4bf6-ae42-8e0f981129bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1259 microversion: 2.1 time: 0.094132 Jul 11 15:52:46.128544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 200/381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:46.990535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:46.991383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:47.000078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:47.000552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:47.001309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:47.001738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:47.144602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:47.145794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:47.146401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:47.154425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:47.155766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:47.156096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:47.157176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:47.157862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:47.158130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:47.159516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-656b1069-d7ad-438f-a90d-428a5112ce67 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.176770 Jul 11 15:52:47.160793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 182/382] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:47.244002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:47.260627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cd1fceac-c60b-4f18-9830-6e0b6c8861d4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1319 microversion: 2.1 time: 0.119299 Jul 11 15:52:47.260854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-464190438", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "networks": [{"uuid": "4a1ddb97-3381-44d1-8db0-be0579f462df"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:47.265925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 201/383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:47.329350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] validate_networks() for [('4a1ddb97-3381-44d1-8db0-be0579f462df', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:52:48.049228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:52:48.050072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:52:48.051117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:52:48.051859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:52:48.052574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:52:48.077586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.085718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.087037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.087741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.129562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Getting quotas for project 6b09e1a0de62456d90789370bba74b53. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:52:48.138699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Getting quotas for user 99827ab52d9242f385177cada4335b38 and project 6b09e1a0de62456d90789370bba74b53. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:52:48.162905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:52:48.168689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:52:48.178359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:48.179657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:48.206230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:48.209712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.210613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.212163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.213141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.272868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-afd730b3-4ea5-482e-805a-a222145c9a46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015928 Jul 11 15:52:48.277649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 183/384] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 15:52:48.292693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:48.300534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:48.320256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.320959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.321917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:48.322499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:48.597816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:48.611966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:48.614741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:48.617316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-45e97a0a-49c4-4c81-95d6-a32f8615dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.442692 Jul 11 15:52:48.617886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 202/385] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:52:48.641041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-33d1d326-ef12-417a-8db9-09e19a3b176b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:48.642142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-33d1d326-ef12-417a-8db9-09e19a3b176b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:48.703647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:48.713191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4674a4f3-5d0b-4901-abc2-2456efd346b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.429189 Jul 11 15:52:48.714176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 184/386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:48.737939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-33d1d326-ef12-417a-8db9-09e19a3b176b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:48.751211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-33d1d326-ef12-417a-8db9-09e19a3b176b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1218 microversion: 2.1 time: 0.116042 Jul 11 15:52:48.753282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 203/387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:48 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:49.638871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:49.639551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:49.646322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.646776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.647546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.647979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.736388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:49.737309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:49.749071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.749526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.750325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.750758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.795902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:49.812482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:49.815145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:49.816823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d02cd71-c80e-4121-914e-bc0f02b75d5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.184314 Jul 11 15:52:49.817955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 185/388] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:52:49.822994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:49.823856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:49.844066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.844721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.845551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:49.846027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:49.926932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:49.933367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:49.938022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9699257-9420-47bc-93a5-171bfaef2eab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.118600 Jul 11 15:52:49.939122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 186/389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:49 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:49.947962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d48e016f-6a05-4bb9-81a1-403e4b33af4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.220480 Jul 11 15:52:49.957856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 204/390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:50.837118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:50.837688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:50.845136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:50.845698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:50.846467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:50.846887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:50.955866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:50.956506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:50.963867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:50.975724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:50.976619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:50.977047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:50.996126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:51.005434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:51.006944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:51.008265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50ee7ad1-f331-4da8-8913-cb38538e7fd3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.175480 Jul 11 15:52:51.009288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 187/391] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:51.026122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:51.026756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:51.035072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:51.035516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:51.036281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:51.036752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:51.055972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:51.064790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-303c8cc1-cbe0-412c-a2be-d20712d30989 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.113096 Jul 11 15:52:51.065377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 205/392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:50 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:51.178104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:51.186213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4f5bed7-530d-4a23-9418-77b1eac7f4b3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.175829 Jul 11 15:52:51.187028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 188/393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:52.027505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:52.028115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:52.034440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.034881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.035645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.036094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.083589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:52.084570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:52.091653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.092107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.092921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.093354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.179362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:52.191287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c52fc1ed-9240-41d3-8d17-97fc7abc1d76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.110569 Jul 11 15:52:52.191959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 189/394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:52 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:52.206792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:52.207408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:52.214644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:52.217759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.218476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.219629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:52.220067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:52.223183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:52.224773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:52.225942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-654c3f1a-99a4-4d8a-92d4-4b5a921ff160 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.202768 Jul 11 15:52:52.226532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 206/395] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:52.358985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:52.366973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1efa7ab-200d-49d1-92aa-f9edcc328f47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.167542 Jul 11 15:52:52.367804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 190/396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:53.210019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:53.210615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:53.217192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.217638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.218542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.219549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.244695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:53.245321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:53.252093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.252586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.253344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.253793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.285069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:53.293726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ebe192e1-15da-4825-ace8-0baa698d983e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.087961 Jul 11 15:52:53.294606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 207/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:53 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:53.385261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:53.385962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:53.393053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:53.393585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.394103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.394978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:53.395462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:53.403474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:53.405032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:53.406270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d529f05-2f4c-4d5c-a59d-7fdb327072f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.165661 Jul 11 15:52:53.406853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 191/398] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:53.549983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:53.558133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63c39786-6854-4d76-93b6-a5840e3f020d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.177140 Jul 11 15:52:53.558915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 208/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:54.311367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:54.312827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:54.320161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.320646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.322138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.323409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.355893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:54.405095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:54.413587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a43c00d6-0c55-422c-b735-e6a15735b478 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.106190 Jul 11 15:52:54.414166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 192/400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:54 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:54.425352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:54.425962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:54.432182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.432930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.433704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.434129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.574534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:54.576773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:54.577459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:54.583984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:54.584385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.584911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.585521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:54.585830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:54.586341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:54.586678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-21aaca7d-3d98-49f3-b017-ea1790b8782a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.166183 Jul 11 15:52:54.588102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 209/401] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:54.723795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:54.731516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2432698a-7093-4e08-bde0-5cd000e6560f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.158776 Jul 11 15:52:54.732389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 193/402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:55.432507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:55.433130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:55.439965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.440442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.441248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.441635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.508624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:55.516690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc34198e-007b-4b20-a536-597820dce408 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.088383 Jul 11 15:52:55.517325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 210/403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:55 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:55.605718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:55.606345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:55.613069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.613511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.614265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.614686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.749038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:55.749930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:55.754116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:55.758706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.759154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.760060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:55.760652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:55.762600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:55.764098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:55.765112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:55.765319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3eb4cb0b-75ba-4d03-acd6-8fde53595ba2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.163591 Jul 11 15:52:55.765950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 194/404] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:55.905503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:55.920622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d43b5e03-57c1-42a3-a632-20020f7f1354 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.175727 Jul 11 15:52:55.921210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 211/405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:56.535152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:56.536369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:56.544550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.546233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:56.546233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.550021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:56.633532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:56.642257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a258822-f716-44c5-89f2-5b9c5459148f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.112466 Jul 11 15:52:56.642864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 195/406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:56 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:56.783554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:56.784144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:56.790701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.791228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:56.792059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.792580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:56.931636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:56.938141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:56.939147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:56.940915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:56.942451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:56.944413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf69d875-44bc-49ec-8cbb-657abb191482 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.165146 Jul 11 15:52:56.945184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 212/407] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:56.946309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.946830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:56.947673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:56.948168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:57.090909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:57.102551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7dc9a19c-fba3-4800-8274-0d334ea696c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.168437 Jul 11 15:52:57.103367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 196/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:57.659257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:57.659941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:57.668515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:57.668958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:57.669758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:57.670183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:57.736649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:57.744397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ee6caf3-6ea0-4800-a1c5-3361b22033ad tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.089079 Jul 11 15:52:57.745190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 213/409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:57 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:57.963367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:57.964010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:57.971384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:57.971832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:57.972645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:57.973069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:58.111561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:58.116962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:58.119303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:58.119915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:58.127072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:58.127274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:58.127678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:58.128574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:58.129076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:58.130072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:58.132242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2b2cc28b-e186-471b-a404-0f1c73d06420 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1723 microversion: 2.20 time: 0.173042 Jul 11 15:52:58.133498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 197/410] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:58.273736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:58.282406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cd09ce94-11f7-475f-9b2d-da170f285111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.166952 Jul 11 15:52:58.282945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 214/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:52:58.761645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:58.762376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:58.764260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=12 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:58.769933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:58.770374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:58.771142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:58.771562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:58.834298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:58.842038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31fc4893-ec4d-49d7-9398-06aced092c25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1222 microversion: 2.1 time: 0.084247 Jul 11 15:52:58.842615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 198/412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:58 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:59.153903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:59.154846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:59.156455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=8 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:59.179686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.180142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.180982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.181417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.299732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:59.300599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:59.319365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.320187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.324212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.324967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.508498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:59.520787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:59.523125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:59.525033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-293bf9a4-2998-4421-add9-1664389d12d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1744 microversion: 2.20 time: 0.375859 Jul 11 15:52:59.526130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 215/413] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:52:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1744 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:52:59.531717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-fddad065-9392-448e-a96a-5c6df912160c req-d9cd370a-f014-43e9-a987-09301d362084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:52:59.541599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fddad065-9392-448e-a96a-5c6df912160c req-d9cd370a-f014-43e9-a987-09301d362084 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.542030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:59.542444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fddad065-9392-448e-a96a-5c6df912160c req-d9cd370a-f014-43e9-a987-09301d362084 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.552521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3171674b-0d84-4386-bb98-a50d0eacbbb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.256751 Jul 11 15:52:59.562657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 199/414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:52:59.565100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-fddad065-9392-448e-a96a-5c6df912160c req-d9cd370a-f014-43e9-a987-09301d362084 service nova] Creating event network-changed:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:52:59.570388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-fddad065-9392-448e-a96a-5c6df912160c req-d9cd370a-f014-43e9-a987-09301d362084 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 Jul 11 15:52:59.570974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 216/415] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:52:59.859396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:52:59.860507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:52:59.867466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.867988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.868867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:52:59.869351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:52:59.947766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:52:59.955480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a7899eb-6594-4c5e-894a-b6038cfc22fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1276 microversion: 2.1 time: 0.100086 Jul 11 15:52:59.956064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 200/416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:52:59 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:00.547148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:00.547833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:00.554656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.555110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:00.555884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.556343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:00.570855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:00.571507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:00.578490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.579107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:00.580324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.580616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:00.864274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:00.868880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:00.872509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64884fd1-f32a-4aa3-b481-f63c265a6f0e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.306201 Jul 11 15:53:00.873302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 201/417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:00.887703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:00.889294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:00.890497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-12b98d17-30d2-419c-a5f5-e247b8c248fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1744 microversion: 2.20 time: 0.347763 Jul 11 15:53:00.891054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 217/418] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1744 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:00.973291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:00.973824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:00.981087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.981552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:00.982321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:00.982753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.170802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:01.179738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-94ef8642-86e8-4713-8e69-bfc32d71aba0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.210406 Jul 11 15:53:01.189390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 202/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:00 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:01.281867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-613343f7-2e88-4d31-96a0-3dbfe50afe4b req-eb54419b-1e07-4188-bd5c-29526c2ae5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834a8b58-69ef-4f46-8a51-829b01da2d0c", "tag": "f73e7403-845a-4c4d-abf9-ad231b8ee9a4"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:01.291107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-613343f7-2e88-4d31-96a0-3dbfe50afe4b req-eb54419b-1e07-4188-bd5c-29526c2ae5d7 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.291521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-613343f7-2e88-4d31-96a0-3dbfe50afe4b req-eb54419b-1e07-4188-bd5c-29526c2ae5d7 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.303437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-613343f7-2e88-4d31-96a0-3dbfe50afe4b req-eb54419b-1e07-4188-bd5c-29526c2ae5d7 service nova] Creating event network-changed:f73e7403-845a-4c4d-abf9-ad231b8ee9a4 for instance 834a8b58-69ef-4f46-8a51-829b01da2d0c on hv-cinder-79760 Jul 11 15:53:01.308119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-613343f7-2e88-4d31-96a0-3dbfe50afe4b req-eb54419b-1e07-4188-bd5c-29526c2ae5d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030140 Jul 11 15:53:01.308940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 218/420] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:01.325197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-086e2a59-5573-4a2d-b972-895a49629ad7 req-fb699522-d42d-43e3-98db-b9c42c9b59f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "name": "network-vif-plugged", "status": "completed", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:01.334810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-086e2a59-5573-4a2d-b972-895a49629ad7 req-fb699522-d42d-43e3-98db-b9c42c9b59f0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.335322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-086e2a59-5573-4a2d-b972-895a49629ad7 req-fb699522-d42d-43e3-98db-b9c42c9b59f0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.347300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-086e2a59-5573-4a2d-b972-895a49629ad7 req-fb699522-d42d-43e3-98db-b9c42c9b59f0 service nova] Creating event network-vif-plugged:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 15:53:01.352452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-086e2a59-5573-4a2d-b972-895a49629ad7 req-fb699522-d42d-43e3-98db-b9c42c9b59f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031012 Jul 11 15:53:01.353053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 203/421] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:01.889768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:01.890884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:01.897508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.897956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.898728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.899157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.910671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:01.911619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:01.918416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.918868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:01.919643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:01.920076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:02.197251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:02.203597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:02.208257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5e96b688-b22b-48c4-8e50-c208dfb75952 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.322741 Jul 11 15:53:02.209193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 219/422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:02.213909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:02.214468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:02.220846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:02.221371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:02.221702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:02.222489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:02.222924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:02.223057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:02.224480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e947da1-18d2-4c80-a515-ea1a0d7b87d1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1744 microversion: 2.20 time: 0.319131 Jul 11 15:53:02.225100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 204/423] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1744 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:02.433424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:02.443132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8333901b-367b-41a1-a4da-256fa856dc30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.232743 Jul 11 15:53:02.443691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 220/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:02 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:03.225963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:03.226572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:03.233597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.234042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.234793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.235223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.242808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:03.243413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:03.249884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.250324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.251110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.251529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.442234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:03.446418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:03.450515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ed4c8f00-9feb-4e17-9a5a-732d17bf7fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.228739 Jul 11 15:53:03.451123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 205/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:03.454738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:03.456795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:03.458092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-87551b5f-2460-4a15-a09f-86ffa200e58e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1744 microversion: 2.20 time: 0.219300 Jul 11 15:53:03.459249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 221/426] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:03.463116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:03.463871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:03.470304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.470831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.471698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:03.472130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:03.612687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:03.620204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-334d8a96-334a-4a42-a5ef-0b672b1cfe96 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.161390 Jul 11 15:53:03.620803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 206/427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:03 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:04.467792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:04.468597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:04.475980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.476495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:04.477147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:04.477598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.478478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.478965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.484040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.484788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.485601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.486058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.698348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:04.715885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-21b33d1c-dbd2-4b32-9612-a59a5a434b26 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.252183 Jul 11 15:53:04.717280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 222/428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:04.731598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:04.732593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:04.733283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:04.739777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.740223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.741016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:04.741472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:04.742586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:04.744394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:04.745806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4329ae8f-370f-497f-ac10-daef628c55ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.273468 Jul 11 15:53:04.746696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 207/429] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:04.880228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:04.888534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d7f896c-ecbc-4dd1-a1f7-b84d57eb0bda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.169311 Jul 11 15:53:04.889125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 223/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:04 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:05.040081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:05.040614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:05.061444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.064596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.065943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.069566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.232866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lazy-loading 'services' on Instance uuid 4b13d806-c073-41ec-8b74-f0dfc037fa88 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:53:05.387906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-51b0d27e-580b-45a7-bc39-284661918f27 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments/eae6e4ca-ddf7-42f7-9849-dcc7aa961f59" status: 202 len: 0 microversion: 2.1 time: 0.351804 Jul 11 15:53:05.392026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 208/431] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 15:53:05 2022] DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments/eae6e4ca-ddf7-42f7-9849-dcc7aa961f59 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:53:05.736775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:05.738213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:05.745547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.746002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.747195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.747713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.765030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:05.765738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:05.782259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.782713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.783497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:05.783943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:05.796972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:06.022417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.030764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54ea3d01-faf6-4c19-9960-945e84562e32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.298130 Jul 11 15:53:06.031378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 224/432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:06.055561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:06.058656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:06.065495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:06.066279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:06.067332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:06.068050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:06.074599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.084565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.087302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.088712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-668443e9-8b90-4030-9c9f-6260173765e8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.328193 Jul 11 15:53:06.098776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 209/433] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:06.234879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.243096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9da8efb8-8340-4391-8b02-b01a2078fc79 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.209937 Jul 11 15:53:06.244715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 225/434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:06 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:06.537290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-73799175-3d29-4868-b656-dda218f29a5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:06.544794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73799175-3d29-4868-b656-dda218f29a5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:06.545223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73799175-3d29-4868-b656-dda218f29a5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:06.573479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-73799175-3d29-4868-b656-dda218f29a5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Going to try to stop instance {{(pid=124241) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 15:53:06.639995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-73799175-3d29-4868-b656-dda218f29a5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action" status: 202 len: 0 microversion: 2.1 time: 0.106866 Jul 11 15:53:06.644228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 210/435] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:53:06 2022] POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:53:06.661490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:06.662190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:06.672530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:06.672530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:06.672530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:06.672530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:06.836039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:06.844547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ebe88e09-baba-4f2b-ad31-acf9a2eb2d23 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.196843 Jul 11 15:53:06.845224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 226/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:06 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:07.048723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:07.049838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:07.058365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.058891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.060628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.061288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.107156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:07.108069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:07.115827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.116275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.117096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.117526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.349208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:07.360399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:07.364462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b12207f0-adbe-498b-8244-a18afd8026c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.320277 Jul 11 15:53:07.365729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 211/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:07.372994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:07.373959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:07.380337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:07.381986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:07.382488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.383130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.384107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2292cb24-6d8a-490e-bbd7-b6b1ce2d92fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.280862 Jul 11 15:53:07.384335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.385090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.395840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 227/438] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:07.572186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:07.573909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-0b3face0-8257-45aa-a977-f3a5865c2a0b req-407dd091-69b4-4336-999e-cfa2f8396bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "name": "network-vif-plugged", "status": "completed", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:07.589924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a698dd0-0718-4b7e-b6d2-24feb23a8de0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.222529 Jul 11 15:53:07.595914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-0b3face0-8257-45aa-a977-f3a5865c2a0b req-407dd091-69b4-4336-999e-cfa2f8396bba service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.596889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 212/439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:07 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:07.597786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-0b3face0-8257-45aa-a977-f3a5865c2a0b req-407dd091-69b4-4336-999e-cfa2f8396bba service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.612030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-0b3face0-8257-45aa-a977-f3a5865c2a0b req-407dd091-69b4-4336-999e-cfa2f8396bba service nova] Creating event network-vif-plugged:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:53:07.617796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-0b3face0-8257-45aa-a977-f3a5865c2a0b req-407dd091-69b4-4336-999e-cfa2f8396bba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049680 Jul 11 15:53:07.618967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 228/440] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:07.867197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:07.868474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:07.876373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.876871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:07.878253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:07.878757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.056411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.066933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87f2517e-0433-4422-873c-d174540c6646 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.207503 Jul 11 15:53:08.068168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 213/441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:07 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:53:08.382972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:08.384456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:08.391333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.392129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.393185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.394058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.402495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:08.403103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:08.411723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.412525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.413552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.414275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.644639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.650795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.654118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.656091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.657064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1025216-a39d-42a9-b117-2ecf088d8dbb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.258497 Jul 11 15:53:08.662129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:08.665954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-893f12ea-6fc8-4e1f-aeb6-518dd9a41369 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.287491 Jul 11 15:53:08.675404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 214/442] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:08.675404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:08.675926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:08.676403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 229/443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:08.682739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.683753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.683997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:08.684487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:08.835392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:08.843615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-840099bd-c86e-4d1b-b2ca-46e0042060e7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.173633 Jul 11 15:53:08.844219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 215/444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:08 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:09.087787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:09.088736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:09.095300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.095754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.097116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.097793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.595108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:09.605279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44eff808-318d-4aab-9ed5-f70dc6e87f5e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.524727 Jul 11 15:53:09.606110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 230/445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:09 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:09.633556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-32fd7a1c-2add-4ad2-b1d0-bd4c13fc389b req-865d6b35-dec7-4d74-b1d5-d6458dd0ceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a8b58-69ef-4f46-8a51-829b01da2d0c", "name": "network-vif-plugged", "status": "completed", "tag": "f73e7403-845a-4c4d-abf9-ad231b8ee9a4"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:09.642587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-32fd7a1c-2add-4ad2-b1d0-bd4c13fc389b req-865d6b35-dec7-4d74-b1d5-d6458dd0ceea service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.643172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-32fd7a1c-2add-4ad2-b1d0-bd4c13fc389b req-865d6b35-dec7-4d74-b1d5-d6458dd0ceea service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.657273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-32fd7a1c-2add-4ad2-b1d0-bd4c13fc389b req-865d6b35-dec7-4d74-b1d5-d6458dd0ceea service nova] Creating event network-vif-plugged:f73e7403-845a-4c4d-abf9-ad231b8ee9a4 for instance 834a8b58-69ef-4f46-8a51-829b01da2d0c on hv-cinder-79760 Jul 11 15:53:09.662430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-32fd7a1c-2add-4ad2-b1d0-bd4c13fc389b req-865d6b35-dec7-4d74-b1d5-d6458dd0ceea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Jul 11 15:53:09.663382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 216/446] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:09.681719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:09.682663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:09.689329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.690058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.691311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.691429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:09.692055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:09.692212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.699232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.699659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.701292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.702568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.945126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:09.960242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:09.968620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:09.969854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7df96d95-01be-4825-8385-7abb791f154d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.292413 Jul 11 15:53:09.970589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 231/447] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:09.975975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:09.976900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:09.981323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:09.984146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.984922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:09.985898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:09.986500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:10.002318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ccab0c15-8995-4826-8b0a-9c96a7a9719d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1359 microversion: 2.1 time: 0.310046 Jul 11 15:53:10.012050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 217/448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:10.241189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:10.249304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b9438f84-d859-4aa3-9d87-9622eda99f9e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.277372 Jul 11 15:53:10.262246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 232/449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:09 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:10.623032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:10.623561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:10.630323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:10.630761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:10.631486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:10.632017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:10.789978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:10.798092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2521e0bc-4ea2-47be-892e-3c0466099440 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.179064 Jul 11 15:53:10.798743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 218/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:10 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:11.013626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.014932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.021355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.021800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.022569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.022998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.041418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.042408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.048962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.049751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.050764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.051409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.252809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.262564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c393e7c5-7e52-4fed-a80e-bd45788f54b2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1549 microversion: 2.1 time: 0.252461 Jul 11 15:53:11.262948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 233/451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1549 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:11.272853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.273477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.282206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.282696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.283424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.284042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.286230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.299677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.302573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.303467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c75c77ff-4812-47c8-b907-60fad91442e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.267002 Jul 11 15:53:11.313789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 219/452] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:11.313789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.313789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.321012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.321468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.322240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.322674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.557103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.568105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-adc8e799-a059-4f67-89e9-e793544666b2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1318 microversion: 2.1 time: 0.304037 Jul 11 15:53:11.569057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 234/453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:11.584465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.595539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62dcea9a-cd4b-4b18-bcbb-056f5328c17e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1549 microversion: 2.1 time: 0.288918 Jul 11 15:53:11.606709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 220/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1549 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:11.612636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.616323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:11.617135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Searching by: {'deleted': False, 'project_id': 'e28a535e7b6044daa85fa92c799f6069'} {{(pid=124242) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 11 15:53:11.624718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.625174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.625955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.626418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.723942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.multi_cell_list [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124242) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 11 15:53:11.815302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.816128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.823076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.823595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.824455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.824955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.825251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b9ed65a-f01b-4be2-9959-6e533c94aa44 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217014 Jul 11 15:53:11.830998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 235/455] 10.222.0.26 () {58 vars in 1124 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:11.836831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:11.837466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:11.844190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.844688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:11.845459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:11.845902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:12.038733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.048830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f7f88247-cc98-48de-b0d6-03ca98855654 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.237584 Jul 11 15:53:12.049722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 221/456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:53:12.070572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.079287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea5e6b3e-7264-480a-be9f-a8e6408d381d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1549 microversion: 2.1 time: 0.246717 Jul 11 15:53:12.080070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 236/457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1549 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:12.321640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:12.322575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:12.339338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:12.340079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:12.341078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:12.341688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:12.536688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.553841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.556723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.558283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4727e01f-5065-4105-a31e-e3461898a1e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.240561 Jul 11 15:53:12.559372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 222/458] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:12.591826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:12.592520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:12.599722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:12.600315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:12.601131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:12.603632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:12.768254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:12.776137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43477854-40cd-404c-b15b-c2d525007a93 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1507 microversion: 2.1 time: 0.190316 Jul 11 15:53:12.776759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 237/459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:12 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:13.068572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:13.070036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:13.076643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.077183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.077956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.078392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.322565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:13.331881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a7365b4-6713-41f9-b5af-9f914e3a35b4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.268262 Jul 11 15:53:13.333019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 223/460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:13 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:13.577518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:13.578191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:13.592663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.593124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.594580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.595025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.776759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86302ded-f409-4874-b1b4-bc671f60eea3"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:13.778470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:13.786733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:13.789194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.790285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.791344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:13.791841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:13.792833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:13.802968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:13.804528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:13.805729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b467e63-3737-46e1-af7c-b492fedabcd1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1739 microversion: 2.20 time: 0.232154 Jul 11 15:53:13.806529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 238/461] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:14.038493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:14.064266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4f4a799-9159-4682-b2d4-82e499be4d49 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291559 Jul 11 15:53:14.064937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 224/462] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:53:13 2022] POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:14.350388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:14.351008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:14.358500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:14.359226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:14.360134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:14.360613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:14.499487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:14.506910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-563c63c7-0f08-4f6c-bb9d-03893296dfbd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.160502 Jul 11 15:53:14.507479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 239/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:14 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:14.825767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:14.826497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:14.833034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:14.833489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:14.834609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:14.835044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:15.043429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:15.052569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:15.054138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:15.055258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d183ef7c-fe6d-4083-bf59-ea7bff43ebaf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1721 microversion: 2.20 time: 0.234391 Jul 11 15:53:15.055851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 225/464] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:15.532345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:15.533271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:15.543329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:15.544023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:15.545252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:15.545964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:15.687270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:15.696471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b408c169-7fd5-437f-a078-a0141e1b0616 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.170292 Jul 11 15:53:15.697037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 240/465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:15 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:16.074819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:16.075434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:16.082554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:16.083034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:16.084118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:16.084583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:16.237076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:16.245270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:16.247050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:16.248269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3a43563-b952-4e2b-9ceb-a510587ad3ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1721 microversion: 2.20 time: 0.177444 Jul 11 15:53:16.248895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 226/466] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:16.718296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:16.719143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:16.729070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:16.729738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:16.730939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:16.731624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:16.868225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:16.875826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f087421e-79b1-4da7-ad94-a03aeee07e19 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1678 microversion: 2.1 time: 0.164031 Jul 11 15:53:16.876376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 241/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:16 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:17.267230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:17.268021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:17.275468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:17.275905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:17.276711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:17.277259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:17.422760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:17.430847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:17.432402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:17.433643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87ace60e-70c8-426e-8113-69991277e31f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1721 microversion: 2.20 time: 0.170474 Jul 11 15:53:17.434137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 227/468] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:17.893059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:17.894173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:17.900257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:17.900768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:17.901511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:17.901969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.042228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:18.054057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98875fbd-6503-4d49-a7f6-2585b1c06056 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1655 microversion: 2.1 time: 0.165025 Jul 11 15:53:18.054815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 242/469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:17 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:18.075165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d88a174b-8d2e-4525-bbed-e8023195179e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:18.082390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d88a174b-8d2e-4525-bbed-e8023195179e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.082841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d88a174b-8d2e-4525-bbed-e8023195179e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.107120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d88a174b-8d2e-4525-bbed-e8023195179e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Going to try to start instance {{(pid=124241) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 15:53:18.160013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d88a174b-8d2e-4525-bbed-e8023195179e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action" status: 202 len: 0 microversion: 2.1 time: 0.088144 Jul 11 15:53:18.160905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 228/470] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:53:18 2022] POST /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:53:18.169386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:18.169992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:18.176136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.176660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.177416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.177844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.354695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:18.362656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e198fcc-ab8d-4758-8cc0-3bb9f869448a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1664 microversion: 2.1 time: 0.197101 Jul 11 15:53:18.363214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 243/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:18 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:18.455450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:18.456390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:18.463346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.463790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.464640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.465071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.675176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:18.683959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:18.685655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:18.686923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb8beccd-f29a-4164-982e-7002ef97e0d6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1664 microversion: 2.20 time: 0.236585 Jul 11 15:53:18.687535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 229/472] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1664 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:18.705670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27cbb78d-7950-4d63-8e1d-b01432dadc35"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:18.706920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:18.709251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=86 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:18.715496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.716137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.717185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:18.717704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:18.940662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:19.045204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f748da29-3288-4596-b388-2235f4b52881 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343578 Jul 11 15:53:19.045898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 244/473] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 11 15:53:18 2022] POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:53:19.173343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:19.173908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:19.180524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.180973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.181738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.182177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.280196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a79502b-46ec-42ce-a7bf-8dbaf7549efa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action" status: 202 len: 0 microversion: 2.20 time: 0.110725 Jul 11 15:53:19.281051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 230/474] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 11 15:53:19 2022] POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:53:19.291588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:19.292417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:19.300015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.300578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.301425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.301931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.379967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:19.380970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:19.389547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.392992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.394300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.394947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.470309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:19.481683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:19.483833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:19.486704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4443f8cc-2bec-4740-b4f4-7dc0adc37122 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1750 microversion: 2.20 time: 0.201254 Jul 11 15:53:19.487635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 245/475] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1750 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:19.494358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-8cdfa07b-018d-4986-a7ba-82b8ce0437fb req-3211a3ad-6127-4519-99b7-f4a5dd9fda0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "name": "network-vif-unplugged", "status": "completed", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:19.505346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8cdfa07b-018d-4986-a7ba-82b8ce0437fb req-3211a3ad-6127-4519-99b7-f4a5dd9fda0d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:19.505786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8cdfa07b-018d-4986-a7ba-82b8ce0437fb req-3211a3ad-6127-4519-99b7-f4a5dd9fda0d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:19.517034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.compute.server_external_events [req-8cdfa07b-018d-4986-a7ba-82b8ce0437fb req-3211a3ad-6127-4519-99b7-f4a5dd9fda0d service nova] Unable to find a host for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd. Dropping event network-vif-unplugged {{(pid=124242) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 15:53:19.518551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-8cdfa07b-018d-4986-a7ba-82b8ce0437fb req-3211a3ad-6127-4519-99b7-f4a5dd9fda0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028248 Jul 11 15:53:19.518749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 246/476] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 15:53:19.608794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:19.618757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-724e83f9-3aaa-42eb-86ac-03cbff0d44f4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1664 microversion: 2.1 time: 0.242930 Jul 11 15:53:19.625322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 231/477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:19 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1664 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:53:20.508470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:20.509115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:20.516577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:20.517104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:20.517892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:20.518561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:20.642860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:20.644343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:20.650988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:20.651520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:20.652514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:20.652951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:20.664730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:20.673289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:20.675391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:20.676664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6df1fc8c-a9b7-4c61-bb48-039a3e73a3f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1750 microversion: 2.20 time: 0.174350 Jul 11 15:53:20.677546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 247/478] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:20.792817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:20.802325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-046e4c54-cdf2-436b-93f7-f6dd09e5ce50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1668 microversion: 2.1 time: 0.163574 Jul 11 15:53:20.802960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 232/479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:20 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:53:21.670555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:21.671284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:21.673342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:21.679237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:21.679676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:21.680463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:21.680890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:21.698255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:21.698839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:21.705831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:21.707058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:21.707670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:21.707980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:21.928673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:21.935408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:21.936914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-56f90328-4d9f-4669-a680-4f7044aa15a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1595 microversion: 2.1 time: 0.270340 Jul 11 15:53:21.937509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 248/480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1595 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:21.945041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:21.946538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:21.947709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e509f27-3a74-4ecb-84ee-682bf0189f02 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1752 microversion: 2.20 time: 0.254827 Jul 11 15:53:21.948368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 233/481] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:22.967427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:22.967967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:22.974578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:22.975067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:22.975835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:22.976261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:23.514770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:23.526860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:23.528828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:23.530026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-630537d7-9706-46de-831f-6a3cc7addc43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.566639 Jul 11 15:53:23.530597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 249/482] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:24.551478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:24.552197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:24.560472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:24.560921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:24.561767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:24.562179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:24.817089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:24.827376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:24.829226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:24.831270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d838aeb5-c04b-470e-af31-cc92a068a1fa req-b1470659-1fb6-41c7-96ea-a3a100f7cfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:24.832623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c00d5fa9-f2b0-402f-90ed-4352aa18b8c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.285381 Jul 11 15:53:24.841833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d838aeb5-c04b-470e-af31-cc92a068a1fa req-b1470659-1fb6-41c7-96ea-a3a100f7cfc9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:24.842614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d838aeb5-c04b-470e-af31-cc92a068a1fa req-b1470659-1fb6-41c7-96ea-a3a100f7cfc9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:24.844706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 234/483] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:24.858651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d838aeb5-c04b-470e-af31-cc92a068a1fa req-b1470659-1fb6-41c7-96ea-a3a100f7cfc9 service nova] Creating event network-changed:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:53:24.867822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d838aeb5-c04b-470e-af31-cc92a068a1fa req-b1470659-1fb6-41c7-96ea-a3a100f7cfc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040750 Jul 11 15:53:24.868513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 250/484] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:25.853897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:25.854819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:25.866752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:25.867194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:25.870072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:25.872404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.151716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-905881229"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:26.153773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:26.161414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:26.172680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:26.177564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:26.178007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.179031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:26.179357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:26.179494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.180986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c165d56-c568-431d-a228-b536a0f9b254 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.332392 Jul 11 15:53:26.181807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 235/485] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:26.325942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.network.security_group_api [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Adding security group bf752da4-994b-4c4b-8d20-fe9ebc405e61 to port 1dde6cf4-4caa-44b8-937b-986dee3f0852 Jul 11 15:53:26.734237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f864e0a-09d1-4c8b-8406-6cfc99662c0a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action" status: 202 len: 0 microversion: 2.1 time: 0.588519 Jul 11 15:53:26.734237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 251/486] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:53:26 2022] POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:53:26.742724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:26.743337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:26.749408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:26.750258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.750603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:26.751032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.883619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-982be790-70f5-466d-88d1-98a5f078f185 req-4aa07fc8-9583-43e2-999d-22c067ccf8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:26.905853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-982be790-70f5-466d-88d1-98a5f078f185 req-4aa07fc8-9583-43e2-999d-22c067ccf8ec service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:26.906694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-982be790-70f5-466d-88d1-98a5f078f185 req-4aa07fc8-9583-43e2-999d-22c067ccf8ec service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:26.925392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-982be790-70f5-466d-88d1-98a5f078f185 req-4aa07fc8-9583-43e2-999d-22c067ccf8ec service nova] Creating event network-changed:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:53:26.936085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-982be790-70f5-466d-88d1-98a5f078f185 req-4aa07fc8-9583-43e2-999d-22c067ccf8ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055898 Jul 11 15:53:26.937189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 252/487] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:26.974449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:26.991444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4195ffb5-8c9c-432c-9522-5c39b6551a30 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1641 microversion: 2.1 time: 0.252382 Jul 11 15:53:27.004401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 236/488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1641 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:27.206180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:27.206884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:27.213704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:27.214484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:27.215494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:27.216139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:27.366192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:27.375246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:27.376787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:27.378671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea7ac540-3d11-4f9b-80dc-eea852ed0667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.177221 Jul 11 15:53:27.379365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 253/489] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:28.402143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:28.404133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:28.414044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:28.415031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:28.416197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:28.416943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:28.567506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:28.576607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:28.578153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:28.579314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c85cadaa-a635-49a3-9afd-9bcaf6ccdb6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.184370 Jul 11 15:53:28.579867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 237/490] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:29.602703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:29.603694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:29.613262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:29.613705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:29.614455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:29.614885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:29.748208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:29.757349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:29.758865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:29.760140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c05e561-aea4-4e63-a8b8-043e3ea4e55e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.164213 Jul 11 15:53:29.760979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 254/491] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:30.788771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:30.789498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:30.796789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:30.797665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:30.798873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:30.799665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:30.938136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:30.942363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:30.948225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:30.949768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:30.950925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4fc71a41-54d7-4811-9d43-e5078e5d8ad8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.173122 Jul 11 15:53:30.951500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 238/492] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:31.349163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a59c7d-5cd8-451e-8f1f-f92fc9f90adb", "device": "/dev/sdb"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:31.350733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:31.357143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:31.357573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:31.358388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:31.358838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:31.972199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:31.973011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:31.983486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:31.984082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:31.985242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:31.985825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:32.132478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:32.142664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:32.144264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:32.145526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7581ab6a-256f-47af-95ff-f0be8e047823 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.178650 Jul 11 15:53:32.146091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 239/493] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:33.163405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:33.164121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:33.170910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:33.171356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:33.172105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:33.172570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:33.307072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:33.317566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:33.319258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:33.320458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1da8a921-b507-48dc-8a41-6213e23c0c10 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.161131 Jul 11 15:53:33.331985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 240/494] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:34.343058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:34.343770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:34.351191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:34.351635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:34.352428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:34.352860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:34.502048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:34.510830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:34.512389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:34.513568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4802418-6a74-4bdf-afa5-ed522fdff471 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.177073 Jul 11 15:53:34.514156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 241/495] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:35.532946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:35.534348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:35.541139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:35.541972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:35.542755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:35.543183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:35.681416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:35.690240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:35.691745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:35.692919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a941a238-bbbb-48e2-8470-d4fe76213e76 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.164583 Jul 11 15:53:35.693481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 242/496] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:36.712825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:36.713577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:36.721135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:36.721135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:36.722290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:36.722957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:36.862249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:36.874562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:36.876061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:36.877654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e05c35b5-e40f-4668-9941-451d77c8bc03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.169085 Jul 11 15:53:36.878521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 243/497] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:37.899863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:37.900779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:37.909992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:37.910587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:37.911637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:37.912208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:38.052920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:38.065176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:38.066671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:38.067884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50f1dcf0-e0c6-4efa-8530-bb1ef8ae543f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.173805 Jul 11 15:53:38.068513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 244/498] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:38.456606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8965e634-53e0-4871-8fa0-153c23212a1a"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:38.457722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:38.464478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:38.464922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:38.465674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:38.466097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:38.750339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11dfbb58-81da-4f5b-897c-2953f1fa3843 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298092 Jul 11 15:53:38.750592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f76942ad-3a96-4a0f-a5fb-c21acc330149 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "POST /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.405304 Jul 11 15:53:38.751081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 245/499] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:53:38 2022] POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:38.751174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 255/500] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:53:31 2022] POST /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c/os-volume_attachments => generated 194 bytes in 7407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:39.092559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:39.093706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:39.101525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:39.101987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:39.102735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:39.103168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:39.313763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:39.323438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:39.325150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:39.326587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-82326d19-7111-4712-9ab5-b0d11031c4ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.241891 Jul 11 15:53:39.327014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 246/501] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:40.346242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:40.346913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:40.354227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:40.354680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:40.355452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:40.355887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:40.566778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:40.575633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:40.577155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:40.578343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7851796a-f1d3-4c09-a0c7-06bb76f9e15e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.236556 Jul 11 15:53:40.578901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 256/502] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:41.603176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:41.604084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:41.613862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:41.614310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:41.615082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:41.615485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:41.755085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:41.763767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:41.765293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:41.766432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c871b45-c590-45b0-aff5-b9995063e9b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.169893 Jul 11 15:53:41.766982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 247/503] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:42.790861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:42.791495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:42.799607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:42.800110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:42.800998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:42.801481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:42.947556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:42.959067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:42.960624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:42.961870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88d1b8e3-08be-46cb-980e-05efa9e9da2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.175408 Jul 11 15:53:42.962363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 257/504] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:43.984121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:43.985180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:43.988897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=50 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:43.994958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:43.995458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:43.996333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:43.996805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:44.224040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:44.232720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:44.234248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:44.235398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a5846a34-2203-4257-a7c2-5b798de091ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.257823 Jul 11 15:53:44.235946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 248/505] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:45.255978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:45.256632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:45.264961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:45.265505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:45.266789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:45.267529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:45.432413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:45.446148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:45.447831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:45.449700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4618795b-af40-4c12-8d2f-0ad13f95eb1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.198033 Jul 11 15:53:45.450487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 258/506] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:46.479634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:46.480895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:46.493013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:46.494961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:46.497084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:46.498460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:46.689903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:46.698753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:46.700347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:46.701529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53fba007-b1f9-4027-98b9-e1b936cf3f6c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.231304 Jul 11 15:53:46.702084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 249/507] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 15:53:47.336493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:47.337501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:47.344681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.345126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.346147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.346581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.370360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lazy-loading 'flavor' on Instance uuid 61dce4e3-c747-471a-994d-8f005b95f31e {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:53:47.475661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:47.505900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0eaa8af0-bd47-4223-9608-a837e48c45ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action" status: 200 len: 32 microversion: 2.1 time: 0.173679 Jul 11 15:53:47.507649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 259/508] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:53:47 2022] POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 15:53:47.517076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:47.517769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:47.525643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.526336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.527417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.528868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.721365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:47.722205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:47.729075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.729575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.730576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:47.731035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:47.753831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:47.764988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0741be0e-cf9c-424f-a1ee-3754f836bfc0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.252290 Jul 11 15:53:47.766000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 250/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:47.953297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:47.963724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:47.965322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:47.966867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-905f14da-f060-45e9-b208-e79b2f6e175c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.249944 Jul 11 15:53:47.976716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 260/510] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:48.786327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:48.787099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:48.795827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:48.796423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:48.797761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:48.798293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:48.938212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:48.946542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5df04b6b-4f20-4509-8b66-c000f2809e3b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.165879 Jul 11 15:53:48.947110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 251/511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:48.985266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:48.985968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:48.988436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=34 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:48.993990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:48.994439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:48.995207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:48.995629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:49.128089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:49.137208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:49.138705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:49.139852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b1a07c65-13f4-43f8-be03-39300460a54e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.158514 Jul 11 15:53:49.140432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 261/512] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:49.582047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-b4179486-d721-49bf-9b33-e2501d963f56 req-ec5cdd68-16cf-402a-95a9-2c429b42e361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "name": "network-vif-plugged", "status": "completed", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:53:49.592199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b4179486-d721-49bf-9b33-e2501d963f56 req-ec5cdd68-16cf-402a-95a9-2c429b42e361 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:49.592672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b4179486-d721-49bf-9b33-e2501d963f56 req-ec5cdd68-16cf-402a-95a9-2c429b42e361 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:49.604948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-b4179486-d721-49bf-9b33-e2501d963f56 req-ec5cdd68-16cf-402a-95a9-2c429b42e361 service nova] Creating event network-vif-plugged:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 15:53:49.610037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-b4179486-d721-49bf-9b33-e2501d963f56 req-ec5cdd68-16cf-402a-95a9-2c429b42e361 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Jul 11 15:53:49.610548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 252/513] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:53:49.967484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:49.968384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:49.979043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:49.979799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:49.981103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:49.981828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:50.114538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:50.122620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44fc59ef-c6b9-42d0-a6da-67140982a130 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.161635 Jul 11 15:53:50.123163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 262/514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:50.159683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:50.160419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:50.166626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:50.167073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:50.167833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:50.168267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:50.311847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:50.321566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:50.323080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:50.324240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30a79821-2a65-42e6-9187-5e4d47b949ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.169626 Jul 11 15:53:50.324800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 253/515] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:51.142938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:51.143988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:51.155146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:51.155896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:51.157209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:51.158024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:51.296437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:51.304643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8ecb602-325c-438b-ad9d-5b3ae19e51ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168101 Jul 11 15:53:51.305223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 263/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:51.343065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:51.343674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:51.351004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:51.351426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:51.352189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:51.352657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:51.488696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:51.492311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:51.498282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:51.499784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:51.500996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-98966c73-f4ee-41c6-99be-f235dc8f8905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1808 microversion: 2.20 time: 0.161944 Jul 11 15:53:51.501635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 254/517] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:52.322802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:52.323418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:52.330350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:52.330800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:52.331561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:52.331998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:52.481082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:52.490325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42b1811f-a26d-42b5-8fdd-e8c50c872e83 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.171549 Jul 11 15:53:52.490935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 264/518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:52.521255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:52.522633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:52.530216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:52.530693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:52.531495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:52.531928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:52.665111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:52.673876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:52.675363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:52.676555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-03c980a5-9025-4edf-bb99-f21222f9e8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1795 microversion: 2.20 time: 0.161136 Jul 11 15:53:52.677107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 255/519] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 15:53:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 15:53:53.511218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:53.512074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:53.521389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:53.521840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:53.522602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:53.523039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:53.671672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:53.680785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d15b5da4-b78b-4b66-9204-5c2ebb3d979b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.176153 Jul 11 15:53:53.681365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 265/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:54.698038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:54.698684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:54.705747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:54.706263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:54.707022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:54.707452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:54.849858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:54.858122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96f41e0f-89f4-4d44-88fe-b10b70bfde47 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164011 Jul 11 15:53:54.858691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 256/521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:55.885913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:55.886909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:55.896076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:55.896560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:55.897319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:55.897751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:56.037687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:56.045557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-010ffa3d-6525-4a92-86a4-9fd872a7c294 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166216 Jul 11 15:53:56.046143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 266/522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:57.064982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:57.065756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:57.073086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:57.073528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:57.074286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:57.074713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:57.208891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:57.217426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aa599a72-582f-453f-8120-73c39306648a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.158244 Jul 11 15:53:57.218026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 257/523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:58.234419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:58.234992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:58.242455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:58.242920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:58.243660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:58.244093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:58.395423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:58.404435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cdcaad57-9d79-4707-8d3e-d926f8fb92db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173855 Jul 11 15:53:58.404982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 267/524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:53:59.422649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:53:59.423312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:53:59.430464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:59.430918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:59.431686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:53:59.432126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:53:59.577029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:53:59.586968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-478e3128-ce31-4a51-8917-edad4e045793 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168312 Jul 11 15:53:59.587545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 258/525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:53:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:00.614188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:00.615170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:00.626622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:00.627073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:00.627837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:00.628284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:00.764695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:00.777087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fed044f-46ed-42ef-82a4-74e845c0a70f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169263 Jul 11 15:54:00.777807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 268/526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:01.796917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:01.797634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:01.805109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:01.805575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:01.806337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:01.806768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:01.947056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:01.958094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a2afbc17-4f10-46cf-9f29-ecb0147b585c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166145 Jul 11 15:54:01.959428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 259/527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:02.451519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:02.453166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:02.461039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.461491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:02.462244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.462681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:02.541082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-353c45c1-6a0f-42f8-8cb5-38a1dd6ec405 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action" status: 202 len: 0 microversion: 2.1 time: 0.095870 Jul 11 15:54:02.541886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 269/528] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:54:02 2022] POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:54:02.550324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:02.551019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:02.557534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.558129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:02.558806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.559272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:02.801836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:02.810569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-35fdfded-4c2e-480a-840a-8cc1da2d1135 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1751 microversion: 2.1 time: 0.264320 Jul 11 15:54:02.811128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 260/529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:54:02.976827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:02.977741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:02.984063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.984543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:02.985310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:02.985827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:03.192379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:03.201010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-412f6d65-b668-4849-bdce-036df1d1b974 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.228453 Jul 11 15:54:03.201596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 270/530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:03.829910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:03.830462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:03.838435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:03.838930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:03.839760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:03.840241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:03.992081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:04.004622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-128c9159-5d3c-41c0-8a9d-d577bd148d35 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.179267 Jul 11 15:54:04.005393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 261/531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:04.223133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:04.224133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:04.234514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:04.235149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:04.236269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:04.236737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:04.378660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:04.387189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d873331-b485-40d9-acec-bf6858e1a145 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170534 Jul 11 15:54:04.387768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 271/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:05.026828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:05.027689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:05.039094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:05.039829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:05.041132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:05.041851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:05.194074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:05.202485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6e62f9c-493e-41eb-81d9-d2440ad98359 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.182478 Jul 11 15:54:05.203057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 262/533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:05.408647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:05.409306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:05.417328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:05.417856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:05.418747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:05.419259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:05.554521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:05.566813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-53ab8722-ab2d-43d3-af93-0ce92ceac117 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164159 Jul 11 15:54:05.567616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 272/534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:06.220552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:06.221160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:06.227867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:06.228319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:06.229095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:06.229523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:06.377315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:06.388225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-85b381cc-2a9a-47ff-963d-205997b27073 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.171302 Jul 11 15:54:06.388920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 263/535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:06.592829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:06.593843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:06.601269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:06.601718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:06.602461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:06.602904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:06.737562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:06.749559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96767a22-2f3b-4c5f-9fc1-4c9884d9f683 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162975 Jul 11 15:54:06.750269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 273/536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:07.409992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:07.410757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:07.419318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:07.419886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:07.420898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:07.421442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:07.578435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:07.591720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9440199f-c15a-422e-9701-adfe9db06244 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.187499 Jul 11 15:54:07.592598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 264/537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:07.772837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:07.773446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:07.780228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:07.780720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:07.781484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:07.781918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:07.922162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:07.926435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:07.931468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e363f71-9089-4b8c-8cc8-95472bdaf220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162525 Jul 11 15:54:07.932053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 274/538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:08.620192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:08.620904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:08.628246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:08.628721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:08.629493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:08.629929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:08.777728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:08.786527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5116dbc3-2cf7-42ed-899a-2c0ac6c0c722 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.179474 Jul 11 15:54:08.787108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 265/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:08.954973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:08.955977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:08.969353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:08.970360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:08.971148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:08.971578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:09.121894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:09.130598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-256a3774-69ef-4b68-8d3f-9a72e9546634 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.183972 Jul 11 15:54:09.131202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 275/540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:09.807209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:09.808216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:09.817655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:09.818102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:09.818886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:09.819322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:09.981446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:09.994085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-547b1b67-0738-4487-92d6-fba8a33f9099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.193361 Jul 11 15:54:09.996329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 266/541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:10.149173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:10.149839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:10.156515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:10.156961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:10.158310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:10.158745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:10.296009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:10.305803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f2901cb5-fde5-4ba3-b7c7-9272b76ed7b7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.161320 Jul 11 15:54:10.306382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 276/542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:11.013168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:11.013951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:11.020689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.021099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.021846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.022274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.039509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:11.040021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:11.046336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.046785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.047547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.048019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.168529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:11.177304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cb85d09b-26a8-4a4b-bcf4-01af8dd0f679 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.168301 Jul 11 15:54:11.177882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 267/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:11.179614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 834a8b58-69ef-4f46-8a51-829b01da2d0c {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:11.297695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9dd661fb-363e-475a-9b8d-31c756961ff0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c/os-volume_attachments/90a59c7d-5cd8-451e-8f1f-f92fc9f90adb" status: 202 len: 0 microversion: 2.1 time: 0.262038 Jul 11 15:54:11.298443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 277/544] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 15:54:11 2022] DELETE /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c/os-volume_attachments/90a59c7d-5cd8-451e-8f1f-f92fc9f90adb => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:54:11.323218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:11.323944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:11.330747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.331265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.332094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:11.332621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:11.469606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:11.483212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b000150c-4fad-4833-a832-80e6eeca153c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163774 Jul 11 15:54:11.484118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 268/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:12.198730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:12.199745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:12.208098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:12.208994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:12.209771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:12.210201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:12.370228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:12.378891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d745aba4-0f78-459d-a662-ad60548cec19 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.186904 Jul 11 15:54:12.379713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 278/546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:12.505747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:12.507462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:12.519393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:12.519858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:12.520640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:12.521068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:12.917293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:12.927478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b1474169-796f-4b02-a978-d07af1dc1965 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1716 microversion: 2.1 time: 0.428383 Jul 11 15:54:12.928211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 269/547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1716 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:13.036248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:13.036801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.043171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.043615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.044398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.044833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.128680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] HTTP exception thrown: Cannot 'detach_volume' instance 61dce4e3-c747-471a-994d-8f005b95f31e while it is in vm_state rescued Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Request method failure captured: Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments/8965e634-53e0-4871-8fa0-153c23212a1a HTTP/1.1 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEag6YXw0V8Ns2rYUS4MeF5L8t83JnP0MsleHCR6D95kVRhHreNBQ2_BQpw0h4naIrMpOyCFpfi_eQSoa-7F1SIzfTJCnYoWWQNuLVUtmHrA0vmzox_gC7uTtHMhfqz1gN3OnXgB2LoeW5lb8Pd6sH3wDFSV1uAVfGMQhz8vVWt-eDo Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:54:13.130313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c230554e8a34a7086e433e797360e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c230554e8a34a7086e433e797360e28"}]}] Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 9d44f1f434534cc0b373943d48d672df Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 15:54:13.131877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Cannot 'detach_volume' instance 61dce4e3-c747-471a-994d-8f005b95f31e while it is in vm_state rescued Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'server_id': '61dce4e3-c747-471a-994d-8f005b95f31e', 'id': '8965e634-53e0-4871-8fa0-153c23212a1a'} Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 61dce4e3-c747-471a-994d-8f005b95f31e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:54:13.132719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 61dce4e3-c747-471a-994d-8f005b95f31e while it is in vm_state rescued Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 61dce4e3-c747-471a-994d-8f005b95f31e while it is in vm_state rescued Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:13.134242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Returning 409 to user: Cannot 'detach_volume' instance 61dce4e3-c747-471a-994d-8f005b95f31e while it is in vm_state rescued {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:54:13.135377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-13c0f556-2280-4478-ab40-b86e1486d68d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments/8965e634-53e0-4871-8fa0-153c23212a1a" status: 409 len: 152 microversion: 2.1 time: 0.099786 Jul 11 15:54:13.135377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 279/548] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 15:54:13 2022] DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments/8965e634-53e0-4871-8fa0-153c23212a1a => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 15:54:13.140877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:13.141412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.147585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.149056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.149810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.150271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.196384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:13.221458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17d32b10-19f5-4749-91f8-eba3babd3d3d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action" status: 202 len: 0 microversion: 2.1 time: 0.083825 Jul 11 15:54:13.222099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 270/549] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:54:13 2022] POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:54:13.230449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:13.231154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.239895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.241022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.241904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.242344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.396383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:13.397632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.404634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.405078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.405844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.406277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.497260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:13.506187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5eef02f-3dfe-4719-a297-f7ae953e15e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1724 microversion: 2.1 time: 0.279550 Jul 11 15:54:13.514106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 280/550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:13.519704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:13.520329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.530300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.530837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.531750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.532249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.558870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 15:54:13.631855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:13.640330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d7d87ae-0f01-4d88-8240-fbd9c90c9bcd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.248874 Jul 11 15:54:13.641486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 271/551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:13.653976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f32b6d94-359e-4718-a959-1579d14d56cc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 204 len: 0 microversion: 2.1 time: 0.138417 Jul 11 15:54:13.654682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 281/552] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:54:13 2022] DELETE /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:54:13.663088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:13.663697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:13.669781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.670232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.670986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:13.671418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:13.821834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:13.829827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4d0ab24c-6c9c-4ea7-8a5a-bf4068559d25 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1513 microversion: 2.1 time: 0.170540 Jul 11 15:54:13.831075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 272/553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:13 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:54:14.527363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:14.528091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:14.537101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.537658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.538868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.539398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.659625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:14.660264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:14.664009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=50 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:14.667836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.668280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.669066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.669496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.677959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:14.686097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c03c961-b99a-444e-adb6-a63ac6e341ed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1724 microversion: 2.1 time: 0.164582 Jul 11 15:54:14.686688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 282/554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:14.818727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:14.827406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78effef6-adb3-4f19-a005-dee6e7fff221 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.171807 Jul 11 15:54:14.827999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 273/555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:14.848742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:14.849342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:14.855691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.856138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.856924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:14.857351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:14.996251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:15.003931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c4b953b5-3080-45d8-b1b0-c7f94ed2366a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1513 microversion: 2.1 time: 0.159247 Jul 11 15:54:15.004543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 283/556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:14 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:15.704740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:15.705826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:15.712879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:15.713328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:15.714089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:15.714521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:15.846030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:15.846595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:15.853572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:15.854080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:15.854873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:15.855303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:15.967188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:15.976488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-798da42c-77bc-45d6-9070-bdd59146c88b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1724 microversion: 2.1 time: 0.275777 Jul 11 15:54:15.977183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 274/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:16.022455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:16.023107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:16.029390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.029846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.030583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.031168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.172620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:16.180780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:16.181615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b413ed5c-053f-4c1b-aae9-b8e4c9275821 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1471 microversion: 2.1 time: 0.163182 Jul 11 15:54:16.182199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 275/558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:16 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:16.193098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-20155c64-f84d-4e09-a95e-f586f41ed82e req-8891b891-0682-4725-af7f-26484b88ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834a8b58-69ef-4f46-8a51-829b01da2d0c", "name": "network-vif-deleted", "tag": "f73e7403-845a-4c4d-abf9-ad231b8ee9a4"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:16.195861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d88f9330-8973-4f13-98c9-ed7e53e330ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.354143 Jul 11 15:54:16.196830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 284/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:16.201827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-20155c64-f84d-4e09-a95e-f586f41ed82e req-8891b891-0682-4725-af7f-26484b88ce9e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.202275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-20155c64-f84d-4e09-a95e-f586f41ed82e req-8891b891-0682-4725-af7f-26484b88ce9e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.214407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-20155c64-f84d-4e09-a95e-f586f41ed82e req-8891b891-0682-4725-af7f-26484b88ce9e service nova] Creating event network-vif-deleted:f73e7403-845a-4c4d-abf9-ad231b8ee9a4 for instance 834a8b58-69ef-4f46-8a51-829b01da2d0c on hv-cinder-79760 Jul 11 15:54:16.219411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-20155c64-f84d-4e09-a95e-f586f41ed82e req-8891b891-0682-4725-af7f-26484b88ce9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030376 Jul 11 15:54:16.219980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 276/560] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:16.839949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:16.840985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:16.847987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.848627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.849290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.849721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.879458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ccd1745-45d7-4bf0-80c1-fa3c50c3dc50 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043517 Jul 11 15:54:16.880017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 285/561] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:54:16 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 15:54:16.944850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:16.945457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:16.952613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.953063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.953831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:16.954262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:16.981856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 15:54:16.993598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:16.994211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:17.000589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.001040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.001862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.002540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.073105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ecf83557-309c-4bef-aa24-0da679f870c5 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 204 len: 0 microversion: 2.1 time: 0.132797 Jul 11 15:54:17.073704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 277/562] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:54:16 2022] DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:54:17.089345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:17.090049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:17.096711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.097594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.098007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.098450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.204214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:17.213684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1a568d0-504a-432e-b287-d01d4059882b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1724 microversion: 2.1 time: 0.223863 Jul 11 15:54:17.214307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 286/563] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:54:17.218911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:17.219480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:17.228710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.229146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.229912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.230336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.254219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:17.261680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.261955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-48acee03-0362-40a5-9695-15a39ba2e9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1674 microversion: 2.1 time: 0.183979 Jul 11 15:54:17.262125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.262544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 278/564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:17 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:54:17.262692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'fault' on Instance uuid 834a8b58-69ef-4f46-8a51-829b01da2d0c {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:17.266932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:17.267967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:17.273828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.274270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.275025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:17.275444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:17.310337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:17.318179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bc81267c-fbe5-4b68-9067-2d6f3eed4da7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1308 microversion: 2.1 time: 0.102906 Jul 11 15:54:17.318729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 287/565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:17 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:17.420848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:17.429309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7c0e7451-e89b-4c1f-8360-93a7d154a185 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.165811 Jul 11 15:54:17.429886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 279/566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:18.231455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:18.232055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:18.239066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.239507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.240260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.240718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.279298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:18.280000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:18.287373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.287899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.288735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.289161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.425898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:18.430189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:18.436965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93fdd601-e878-4e38-a312-65d31578d2fd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1724 microversion: 2.1 time: 0.209391 Jul 11 15:54:18.437571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 288/567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:18.444861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:18.445406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:18.454049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.454576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.455407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.456116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.456797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:18.465276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57321909-9cbd-4635-aeb6-3ef305ff842b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1674 microversion: 2.1 time: 0.189939 Jul 11 15:54:18.466187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 280/568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:18 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:18.470997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:18.471918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:18.478005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.478444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.479197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.479618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.498082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:18.498527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:18.498971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'fault' on Instance uuid 834a8b58-69ef-4f46-8a51-829b01da2d0c {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:18.546869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:18.554463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e9957156-4c46-42c0-83db-19ac71b59108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1308 microversion: 2.1 time: 0.115933 Jul 11 15:54:18.555002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 289/569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:18 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:18.657583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:18.666009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6c645e8c-dc58-458b-ae37-d3bcd36b8e99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.198778 Jul 11 15:54:18.666580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 281/570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:19.460171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:19.461055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:19.464693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:19.473621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.474227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.475029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.475462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.483123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:19.483734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:19.490728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.491211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.491987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.492454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.657531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:19.666277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-341b7170-11ea-4298-b41d-0e78fec91289 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1730 microversion: 2.1 time: 0.213508 Jul 11 15:54:19.666979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 290/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:19.671460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:19.672058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:19.680233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:19.683927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.684406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.685188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.685646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.687882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b89ce3ce-138a-477a-8b79-0bb6cea00a40 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1674 microversion: 2.1 time: 0.208758 Jul 11 15:54:19.688475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 282/572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:19 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:19.693034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:19.693668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:19.699658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.700104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.700897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.701324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.718619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.718970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.719420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'fault' on Instance uuid 834a8b58-69ef-4f46-8a51-829b01da2d0c {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:19.802983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:19.810844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eece6213-a938-45a3-a0a9-b887593f3726 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 200 len: 1308 microversion: 2.1 time: 0.142863 Jul 11 15:54:19.811412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 291/573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:19 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:19.821051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:19.822467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:19.828976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.829420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.830187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:19.830622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:19.889386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:19.897954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1784e11a-9b60-48ae-b126-8a7bf1f3786b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1756 microversion: 2.1 time: 0.208463 Jul 11 15:54:19.898747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 283/574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:19.925845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f6e699bb-fe7c-4232-a089-1c82c60ea7e5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108209 Jul 11 15:54:19.926449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 292/575] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 15:54:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:20.706080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:20.707640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:20.714874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.716102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.717543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.718751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.829196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:20.830345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 834a8b58-69ef-4f46-8a51-829b01da2d0c] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:20.838567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.839245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.840198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.840811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.858146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] HTTP exception thrown: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Request method failure captured: Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c HTTP/1.1 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEdNvZy9yflCrMpFp8Osq7uPJLM-7zobldm-wm42W--58q5VwHsniMlEnzA3gxXy0rhD3edYBaR_anfSqMV05IfQGedbf_d3J2NMAkjWnWrTI436QWrvBBRJx6nhjOyaWnGpW_f-daQ-xUaqFsZnd7lz-9PxLrqQhDnz9jzyU1eUk3Q Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:54:20.860074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b09e1a0de62456d90789370bba74b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b09e1a0de62456d90789370bba74b53"}]}] Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 99827ab52d9242f385177cada4335b38 Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. Jul 11 15:54:20.861612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '834a8b58-69ef-4f46-8a51-829b01da2d0c'} Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:54:20.862557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. Jul 11 15:54:20.864047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:20.866178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Returning 404 to user: Instance 834a8b58-69ef-4f46-8a51-829b01da2d0c could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:54:20.867026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-336d7503-3043-4796-b042-88306e533c7b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c" status: 404 len: 111 microversion: 2.1 time: 0.041776 Jul 11 15:54:20.871263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 293/576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:20 2022] GET /compute/v2.1/servers/834a8b58-69ef-4f46-8a51-829b01da2d0c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:54:20.876157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-fd972085-db9d-4e7d-a095-603593f2a3b8 req-1f145812-0bc5-4bcb-a373-cb3c65634d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:20.884796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fd972085-db9d-4e7d-a095-603593f2a3b8 req-1f145812-0bc5-4bcb-a373-cb3c65634d25 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.885505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fd972085-db9d-4e7d-a095-603593f2a3b8 req-1f145812-0bc5-4bcb-a373-cb3c65634d25 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.907939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-fd972085-db9d-4e7d-a095-603593f2a3b8 req-1f145812-0bc5-4bcb-a373-cb3c65634d25 service nova] Creating event network-changed:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 15:54:20.913976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-fd972085-db9d-4e7d-a095-603593f2a3b8 req-1f145812-0bc5-4bcb-a373-cb3c65634d25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041304 Jul 11 15:54:20.914852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 294/577] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:20.920567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:20.921388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:20.928281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.928737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:20.929611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:20.929941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:21.118736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:21.127192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1c00bcc-42cd-4a12-a503-dda699e5306a tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1674 microversion: 2.1 time: 0.425483 Jul 11 15:54:21.128590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 284/578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:20 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1674 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:21.286470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:21.299590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a3da1169-a169-40fe-b32c-f40c2c754fb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1759 microversion: 2.1 time: 0.383376 Jul 11 15:54:21.312283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 295/579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1759 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:21.732046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-b5368dd0-9212-44cf-ae7a-446475027958 req-47b6f561-b068-4221-9c60-c6b7850e31fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b13d806-c073-41ec-8b74-f0dfc037fa88", "name": "network-vif-deleted", "tag": "bbde3788-fd0a-43b7-805f-a658829f18d7"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:21.741155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b5368dd0-9212-44cf-ae7a-446475027958 req-47b6f561-b068-4221-9c60-c6b7850e31fa service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:21.741591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b5368dd0-9212-44cf-ae7a-446475027958 req-47b6f561-b068-4221-9c60-c6b7850e31fa service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:21.755264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-b5368dd0-9212-44cf-ae7a-446475027958 req-47b6f561-b068-4221-9c60-c6b7850e31fa service nova] Creating event network-vif-deleted:bbde3788-fd0a-43b7-805f-a658829f18d7 for instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 on hv-cinder-79760 Jul 11 15:54:21.760420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-b5368dd0-9212-44cf-ae7a-446475027958 req-47b6f561-b068-4221-9c60-c6b7850e31fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031952 Jul 11 15:54:21.761167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 285/580] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:22.146414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:22.147007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:22.159004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:22.159463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:22.160227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:22.160690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:22.232879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:22.240882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5f82d5d3-779a-4a80-bc9a-5d8bf011f4d3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1606 microversion: 2.1 time: 0.098628 Jul 11 15:54:22.242260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 296/581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:22 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:22.931518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-dd462afd-5c73-4f50-adf7-0240ffa0c804 req-62b25b66-0099-4fc6-9859-c5e4f33c8fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:22.941144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-dd462afd-5c73-4f50-adf7-0240ffa0c804 req-62b25b66-0099-4fc6-9859-c5e4f33c8fb4 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:22.941590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-dd462afd-5c73-4f50-adf7-0240ffa0c804 req-62b25b66-0099-4fc6-9859-c5e4f33c8fb4 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:22.952702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-dd462afd-5c73-4f50-adf7-0240ffa0c804 req-62b25b66-0099-4fc6-9859-c5e4f33c8fb4 service nova] Creating event network-changed:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 15:54:22.958075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-dd462afd-5c73-4f50-adf7-0240ffa0c804 req-62b25b66-0099-4fc6-9859-c5e4f33c8fb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Jul 11 15:54:22.959008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 286/582] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:54:23.259173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:23.259777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:23.266989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:23.267434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:23.268322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:23.268779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:23.331643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:23.339795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b43793df-e22f-46e1-83bc-08b89d12150f tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1606 microversion: 2.1 time: 0.084848 Jul 11 15:54:23.340364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 297/583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:23 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:24.359039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:24.359758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:24.370378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:24.370731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:24.372031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:24.372522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:24.406372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:24.422220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:24.422934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:24.423419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lazy-loading 'fault' on Instance uuid 4b13d806-c073-41ec-8b74-f0dfc037fa88 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:24.504446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:24.514743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95448ae5-6d76-4843-89c1-88f129da5c96 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 200 len: 1328 microversion: 2.1 time: 0.160830 Jul 11 15:54:24.516441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 287/584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:24 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:25.533253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:25.533852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:25.541144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:25.541573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:25.542310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:25.542771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:25.556753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 HTTP/1.1 Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 15:54:25.558479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 15:54:25.560072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '4b13d806-c073-41ec-8b74-f0dfc037fa88'} Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 15:54:25.560998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 15:54:25.562416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 15:54:25.563711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 15:54:25.563711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-36535977-f9d0-48a6-a5df-ec5bcffea48c tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 404 len: 111 microversion: 2.1 time: 0.030496 Jul 11 15:54:25.563711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 298/585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:25 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 15:54:25.569460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-20d1e4f8-32f2-4c35-90f9-a83b7f8d85fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '.version_select at 0x7f20b32a8dc0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:25.593249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-20d1e4f8-32f2-4c35-90f9-a83b7f8d85fa tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879361323" status: 202 len: 0 microversion: 2.1 time: 0.027919 Jul 11 15:54:25.593851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 288/586] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 15:54:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879361323 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:54:26.281856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8925131c-bc01-446b-99bf-234cfa64a17b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'create', calling method: .version_select at 0x7f20b32068b0>, body: {"keypair": {"name": "tempest-keypair-1527143253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqr7Qm/WV1AACr/WmvLTSfVRAKzK3AyslKf4TkGdUdTdbqBicXwRx0rNzgmjOW3nciZwZsg74Sye3xfTXOB5EgqpKtx3emb2c0tcxAVIDv+LA5r2EB8XHCfgnMsj78Wg=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:26.297328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-8925131c-bc01-446b-99bf-234cfa64a17b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:54:26.301551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-8925131c-bc01-446b-99bf-234cfa64a17b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for user 052b95d2857c4e728a8008d00fc34780 and project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:54:26.327254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8925131c-bc01-446b-99bf-234cfa64a17b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049319 Jul 11 15:54:26.327867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 299/587] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 15:54:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:27.885868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1616619353", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19ffd085-49b4-45aa-95c3-202792f9f19a"}], "security_groups": [{"name": "tempest-securitygroup--74560702"}], "key_name": "tempest-keypair-1527143253", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:27.990099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] validate_networks() for [('19ffd085-49b4-45aa-95c3-202792f9f19a', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:54:28.374098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:54:28.374803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:54:28.375575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:54:28.376255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:54:28.377029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:54:28.387214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:28.387657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:28.388492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:28.388927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:28.406359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:54:28.411388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Getting quotas for user 052b95d2857c4e728a8008d00fc34780 and project f6145a3ef3d147afbeb90dd49d01af2e. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:54:28.426412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:54:28.428617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:54:28.482863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d498fb4f-3e3f-4a35-95c3-92bdd8263207 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.601644 Jul 11 15:54:28.483964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 289/588] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:54:27 2022] POST /compute/v2.1/servers => generated 400 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 15:54:28.497934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-85523203-8679-4ca8-8133-4f9380e52614 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:28.498791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-85523203-8679-4ca8-8133-4f9380e52614 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:28.553512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-85523203-8679-4ca8-8133-4f9380e52614 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:28.561602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-85523203-8679-4ca8-8133-4f9380e52614 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1238 microversion: 2.1 time: 0.068338 Jul 11 15:54:28.562131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 300/589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:28 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:28.881241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1534655360", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "networks": [{"uuid": "4a1ddb97-3381-44d1-8db0-be0579f462df"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:28.934152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] validate_networks() for [('4a1ddb97-3381-44d1-8db0-be0579f462df', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 15:54:29.298801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 15:54:29.299226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 15:54:29.299856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 15:54:29.300376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 15:54:29.300821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 15:54:29.310342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:29.310802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:29.311596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:29.312024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:29.329358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Getting quotas for project 6b09e1a0de62456d90789370bba74b53. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 15:54:29.333805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Getting quotas for user 99827ab52d9242f385177cada4335b38 and project 6b09e1a0de62456d90789370bba74b53. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 15:54:29.345323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 15:54:29.347527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 15:54:29.403723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b440cea8-d56d-404b-ac29-52db58408ea1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527421 Jul 11 15:54:29.408680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 290/590] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 15:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 15:54:29.414816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42bb1bd8-b3aa-4d57-bd3b-c78d88860525 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:29.415398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42bb1bd8-b3aa-4d57-bd3b-c78d88860525 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:29.481118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42bb1bd8-b3aa-4d57-bd3b-c78d88860525 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:29.488034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42bb1bd8-b3aa-4d57-bd3b-c78d88860525 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1219 microversion: 2.1 time: 0.077278 Jul 11 15:54:29.488714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 301/591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:29.582678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:29.583629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:29.592614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:29.593070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:29.593848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:29.594366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:29.681703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:29.692128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2671a959-cab7-43eb-9aa4-cbac79dde07e tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1308 microversion: 2.1 time: 0.116291 Jul 11 15:54:29.702757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 291/592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:29 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:30.510685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:30.512049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:30.521932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:30.522760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:30.525224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:30.525889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:30.637466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:30.646854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4ad4d51-153e-46b8-b3aa-a69067fbc148 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1289 microversion: 2.1 time: 0.144601 Jul 11 15:54:30.647372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 302/593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:30.711928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:30.713795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:30.722250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:30.723312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:30.724324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:30.724969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:30.927312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:30.941224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11981e74-3728-4911-b79a-9e5654360ee3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.235210 Jul 11 15:54:30.950767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 292/594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:30 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:31.030866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-57041448-f575-4fe5-a40c-a919fd44933f req-08f7c147-3a74-434d-a518-66f33b3e0695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6fcee3-9b96-4b38-b57e-114c6778e58a", "tag": "79bbf21a-ab7c-4406-9e24-a2fadd5b3254"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:31.041935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-57041448-f575-4fe5-a40c-a919fd44933f req-08f7c147-3a74-434d-a518-66f33b3e0695 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.045090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-57041448-f575-4fe5-a40c-a919fd44933f req-08f7c147-3a74-434d-a518-66f33b3e0695 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.065776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-57041448-f575-4fe5-a40c-a919fd44933f req-08f7c147-3a74-434d-a518-66f33b3e0695 service nova] Creating event network-changed:79bbf21a-ab7c-4406-9e24-a2fadd5b3254 for instance af6fcee3-9b96-4b38-b57e-114c6778e58a on hv-cinder-79760 Jul 11 15:54:31.076191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-57041448-f575-4fe5-a40c-a919fd44933f req-08f7c147-3a74-434d-a518-66f33b3e0695 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046804 Jul 11 15:54:31.076998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 303/595] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:31.666103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:31.666715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:31.674236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.674692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.676224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.676707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.866946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:31.874829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bbd2dafd-6d35-40ca-bce6-c591c5fe3f2d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.213861 Jul 11 15:54:31.875409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 293/596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:31 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:31.960549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:31.961429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:31.967941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.968458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.969328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.969953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.975984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-588cf4b5-ef29-4ec0-ab4d-21832e3ba19f req-f96aac7e-189d-4aab-942a-d5b1fa4536a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88cc8ab2-ba6d-49ba-af09-a265ba22234a", "tag": "88d23ed5-4317-4cea-94b2-c4f3cbaf4e65"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:31.984354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-588cf4b5-ef29-4ec0-ab4d-21832e3ba19f req-f96aac7e-189d-4aab-942a-d5b1fa4536a3 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:31.984813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-588cf4b5-ef29-4ec0-ab4d-21832e3ba19f req-f96aac7e-189d-4aab-942a-d5b1fa4536a3 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:31.997135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-588cf4b5-ef29-4ec0-ab4d-21832e3ba19f req-f96aac7e-189d-4aab-942a-d5b1fa4536a3 service nova] Creating event network-changed:88d23ed5-4317-4cea-94b2-c4f3cbaf4e65 for instance 88cc8ab2-ba6d-49ba-af09-a265ba22234a on hv-cinder-79760 Jul 11 15:54:32.001888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-588cf4b5-ef29-4ec0-ab4d-21832e3ba19f req-f96aac7e-189d-4aab-942a-d5b1fa4536a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031060 Jul 11 15:54:32.002490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 294/597] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:32.115228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:32.126100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fec6d61e-17fa-4de2-88ff-3122ccd9ee54 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.171295 Jul 11 15:54:32.126881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 304/598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:31 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:32.894577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:32.896057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:32.902680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:32.903377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:32.904148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:32.904689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:33.120491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:33.128556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c0d83d6-47e9-43e8-a091-0cfcc2bf5697 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.239319 Jul 11 15:54:33.129172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 295/599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:33.143406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:33.144776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:33.151943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:33.152418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:33.153178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:33.153641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:33.288795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:33.296205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd47cd35-3407-44c4-9d01-95773fb5abf3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.156684 Jul 11 15:54:33.296796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 305/600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:33 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:34.148051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:34.148840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:34.157079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:34.157633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:34.158570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:34.159103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:34.301791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:34.310879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-179a175e-547a-4e0a-a74b-61c44556da24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.168605 Jul 11 15:54:34.311480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 296/601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:34.313450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:34.314064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:34.321257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:34.321710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:34.322475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:34.322926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:34.453369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:34.462334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c0b9995f-445c-4cb4-9f3e-67a3f0b40a65 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.152752 Jul 11 15:54:34.462896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 306/602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:34 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:54:35.333919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:35.334935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:35.346027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:35.346965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:35.348333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:35.348783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:35.479443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:35.479987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:35.486679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:35.487136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:35.487993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:35.488651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:35.496719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:35.505466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8516b2b6-e1a3-482e-bd86-a79204696939 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.179249 Jul 11 15:54:35.506259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 297/603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:35.625162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:35.632845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-58813d6b-ca6b-4d25-9bbc-7444c4cf6248 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.157668 Jul 11 15:54:35.633454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 307/604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:35 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:36.526388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:36.527259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:36.537946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:36.538401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:36.539175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:36.539606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:36.650275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:36.651078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:36.657982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:36.658529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:36.659370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:36.660007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:36.675199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:36.682816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d45b077b-f6f5-4d8d-ae01-44f0f5e1cc57 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.163461 Jul 11 15:54:36.683416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 298/605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:36.794528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:36.805348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-99dc2b38-4a8b-4ec5-9fd7-387a7b930edd tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.158965 Jul 11 15:54:36.806080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 308/606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:36 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:37.200159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-abd17d47-de74-473e-adb4-4d4bd7c3d97f req-ae63fee5-da9a-4613-bcc7-c966aca7567e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cc8ab2-ba6d-49ba-af09-a265ba22234a", "name": "network-vif-plugged", "status": "completed", "tag": "88d23ed5-4317-4cea-94b2-c4f3cbaf4e65"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:37.208969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-abd17d47-de74-473e-adb4-4d4bd7c3d97f req-ae63fee5-da9a-4613-bcc7-c966aca7567e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:37.209407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-abd17d47-de74-473e-adb4-4d4bd7c3d97f req-ae63fee5-da9a-4613-bcc7-c966aca7567e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:37.220636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-abd17d47-de74-473e-adb4-4d4bd7c3d97f req-ae63fee5-da9a-4613-bcc7-c966aca7567e service nova] Creating event network-vif-plugged:88d23ed5-4317-4cea-94b2-c4f3cbaf4e65 for instance 88cc8ab2-ba6d-49ba-af09-a265ba22234a on hv-cinder-79760 Jul 11 15:54:37.225681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-abd17d47-de74-473e-adb4-4d4bd7c3d97f req-ae63fee5-da9a-4613-bcc7-c966aca7567e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Jul 11 15:54:37.226458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 299/607] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:37.702318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:37.702886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:37.711357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:37.711801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:37.712594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:37.713026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:37.827370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:37.828182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:37.835241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:37.835796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:37.836731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:37.837230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:37.942711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:37.950661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7f034bf7-ea28-4afc-87ff-00905d569ab6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.253309 Jul 11 15:54:37.951251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 309/608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:37 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:37.989831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:37.997914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78fbd34b-aa8e-4f12-88df-809a94f49818 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.175406 Jul 11 15:54:37.998496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 300/609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:37 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:38.971934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:38.973023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:38.980737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:38.981186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:38.981939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:38.982369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:39.015655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:39.016196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:39.023772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:39.024220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:39.025022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:39.025434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:39.116553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:39.120228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:39.124840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-179825b3-ac2a-4f1a-a8f0-6f370fbb9feb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1319 microversion: 2.1 time: 0.159400 Jul 11 15:54:39.125433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 310/610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:39.223290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:39.230830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc280a2c-aaf4-4bcd-898d-213862c6de5b tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.219052 Jul 11 15:54:39.240683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 301/611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:39 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:39.262019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7cd9e5c0-f9fb-42f6-9758-5813e6485d97 req-587b2182-8ed6-4fb7-a98f-500bf9ae19c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6fcee3-9b96-4b38-b57e-114c6778e58a", "name": "network-vif-plugged", "status": "completed", "tag": "79bbf21a-ab7c-4406-9e24-a2fadd5b3254"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:39.270969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7cd9e5c0-f9fb-42f6-9758-5813e6485d97 req-587b2182-8ed6-4fb7-a98f-500bf9ae19c5 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:39.270969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7cd9e5c0-f9fb-42f6-9758-5813e6485d97 req-587b2182-8ed6-4fb7-a98f-500bf9ae19c5 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:39.283026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7cd9e5c0-f9fb-42f6-9758-5813e6485d97 req-587b2182-8ed6-4fb7-a98f-500bf9ae19c5 service nova] Creating event network-vif-plugged:79bbf21a-ab7c-4406-9e24-a2fadd5b3254 for instance af6fcee3-9b96-4b38-b57e-114c6778e58a on hv-cinder-79760 Jul 11 15:54:39.288225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7cd9e5c0-f9fb-42f6-9758-5813e6485d97 req-587b2182-8ed6-4fb7-a98f-500bf9ae19c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030305 Jul 11 15:54:39.288865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 311/612] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:40.141852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:40.142486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:40.144413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:40.145079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=12 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:40.151932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.152399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.153192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.153617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.244814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=8 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:40.249691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:40.250386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:40.257471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.257916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.258710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.259142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.295139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:40.303018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d60bdbb-2a88-4bcc-b72f-8aa6462fbfb7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1508 microversion: 2.1 time: 0.165011 Jul 11 15:54:40.303698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 302/613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:40.319491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f5069b-f17a-4118-8fbc-23dd7f6de61d", "device": "/dev/sdb"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:40.321102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:40.322912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:40.329196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.329875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.330649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:40.331078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:40.392916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:40.401170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26d1ce4e-85cc-4474-ad74-e6d1023cae90 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1362 microversion: 2.1 time: 0.157386 Jul 11 15:54:40.403196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 312/614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:40 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:40.628649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66d57e27-f92a-4ea8-8f4c-2dd13393030c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "POST /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312969 Jul 11 15:54:40.629321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 303/615] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 15:54:40 2022] POST /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:54:41.420221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:41.421630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:41.430315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.431201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.431982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.432453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.478531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:41.479083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:41.486114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.486559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.487319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.487747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.519600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1214dd0-874b-4b1a-bb5c-c695b2d7bac2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments/27cbb78d-7950-4d63-8e1d-b01432dadc35" status: 200 len: 194 microversion: 2.20 time: 0.047432 Jul 11 15:54:41.520187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 304/616] 10.222.0.26 () {60 vars in 1453 bytes} [Mon Jul 11 15:54:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments/27cbb78d-7950-4d63-8e1d-b01432dadc35 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:54:41.569245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:41.576523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dcf3ed1f-f90a-45bf-8b82-e244363d0d34 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1548 microversion: 2.1 time: 0.161490 Jul 11 15:54:41.577120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 313/617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:41 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:41.584601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:41.585092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:41.591124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.591568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.592343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.592773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.594303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:41.594803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:41.602045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.602568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.603450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.603902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.675562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lazy-loading 'services' on Instance uuid 4a6ea184-76c8-4450-97c5-b81cbc8aacbd {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:41.679198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:41.683206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-944f083f-0dc5-4104-b2fd-df6acc021cbf tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092848 Jul 11 15:54:41.683861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 314/618] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 15:54:41 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:41.796219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8813a45-64d3-4e39-a30c-5c959c664ec1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments/27cbb78d-7950-4d63-8e1d-b01432dadc35" status: 202 len: 0 microversion: 2.20 time: 0.215853 Jul 11 15:54:41.797245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 305/619] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 11 15:54:41 2022] DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments/27cbb78d-7950-4d63-8e1d-b01432dadc35 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:54:41.806144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:41.807077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:41.815135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.815653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.816529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:41.817032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:41.848969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54c44aaa-3b9c-4b5b-9fe8-b70114190b6b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047132 Jul 11 15:54:41.850022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 315/620] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:42.863223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:42.864271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:42.871918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:42.872375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:42.873131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:42.873574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:42.896387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7bdf561c-3aaf-4311-ae3c-a23f54c8f7a6 req-cd8e8213-005f-4680-b07b-0db1a1cfcb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6fcee3-9b96-4b38-b57e-114c6778e58a", "tag": "79bbf21a-ab7c-4406-9e24-a2fadd5b3254"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:42.905696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7bdf561c-3aaf-4311-ae3c-a23f54c8f7a6 req-cd8e8213-005f-4680-b07b-0db1a1cfcb3f service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:42.906149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7bdf561c-3aaf-4311-ae3c-a23f54c8f7a6 req-cd8e8213-005f-4680-b07b-0db1a1cfcb3f service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:42.908334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19454686-5601-47d4-a70d-9bf7ef8730be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050452 Jul 11 15:54:42.912839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 306/621] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:42.918377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7bdf561c-3aaf-4311-ae3c-a23f54c8f7a6 req-cd8e8213-005f-4680-b07b-0db1a1cfcb3f service nova] Creating event network-changed:79bbf21a-ab7c-4406-9e24-a2fadd5b3254 for instance af6fcee3-9b96-4b38-b57e-114c6778e58a on hv-cinder-79760 Jul 11 15:54:42.923558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7bdf561c-3aaf-4311-ae3c-a23f54c8f7a6 req-cd8e8213-005f-4680-b07b-0db1a1cfcb3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030926 Jul 11 15:54:42.924185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 316/622] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:54:43.920923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:43.921973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:43.929315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:43.929848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:43.930617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:43.931054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:43.962171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f7c7bce2-e1c7-4246-8351-f92e193a844b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Jul 11 15:54:43.963063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 307/623] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:44.981110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:44.983392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:44.994044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:44.994785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:44.996034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:44.996530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:45.026241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8fc0fc87-352b-4f8c-8c71-7bd06577d77e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054492 Jul 11 15:54:45.027334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 317/624] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:46.039165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:46.040101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:46.052507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:46.053289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:46.054705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:46.055471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:46.094842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39a172b1-8b8f-436b-83f7-69ca15f36f2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059753 Jul 11 15:54:46.095333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 308/625] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:47.107716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:47.108681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:47.117285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:47.117680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:47.118464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:47.118879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:47.155337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0cc27eb0-b018-48c1-9132-d7134dbc2722 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051862 Jul 11 15:54:47.155890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 318/626] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:48.167601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:48.168719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:48.175214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:48.175656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:48.176717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:48.177184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:48.209337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b82b5586-b93a-4ed6-8ff0-6700ec80e9d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045705 Jul 11 15:54:48.210093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 309/627] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:49.222578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:49.223662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:49.234705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:49.235164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:49.235939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:49.236526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:49.272431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d4b5300d-f939-490a-af5a-31961d8ba771 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054676 Jul 11 15:54:49.273013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 319/628] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:54:50.287556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:50.289099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:50.298076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:50.298703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:50.299825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:50.300576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:50.333518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-68ccec4c-4a91-4cac-8d68-ca099be07853 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051233 Jul 11 15:54:50.334108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 310/629] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:50.968165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:50.968750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:50.971072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:50.976678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:50.977114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:50.977869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:50.978303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:51.006964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 15:54:51.096058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ea18832-c38d-4ce7-bb1c-ac319de6bb03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 204 len: 0 microversion: 2.1 time: 0.132027 Jul 11 15:54:51.096707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 320/630] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 15:54:50 2022] DELETE /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 15:54:51.105455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:51.106220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:51.113812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:51.114243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:51.115004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:51.115433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:51.279419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:51.288176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c946546f-7fa6-4c4c-b316-cb5df4704d85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.186747 Jul 11 15:54:51.288874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 311/631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:51.349769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:51.350827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:51.358924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:51.359356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:51.360138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:51.360581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:51.397883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8afc6735-d966-4b4b-89b1-9ded86144916 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054629 Jul 11 15:54:51.398443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 321/632] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:52.311138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:52.312138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:52.323188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:52.323938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:52.325265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:52.326042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:52.410752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:52.411850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:52.418434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:52.418900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:52.419654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:52.420779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:52.451667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-84aac16f-ed19-4946-80ce-6715f7aa1321 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044698 Jul 11 15:54:52.452174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 322/633] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:52.466643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:52.474397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c533e0a6-de68-4470-a4cd-af23fded82f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.169832 Jul 11 15:54:52.474971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 312/634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:53.463951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:53.464905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:53.471917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:53.472416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:53.473179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:53.473600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:53.491754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:53.492429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:53.499498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:53.499949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:53.500738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:53.501174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:53.503885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d7d8a3e-d23b-4ae2-8f85-37a81c1e501a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043950 Jul 11 15:54:53.504497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 323/635] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:53.650878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:53.659535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3518a869-9cda-4b29-aa83-5ec4c9384af9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.171682 Jul 11 15:54:53.660112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 313/636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:54.516144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:54.517127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:54.523859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:54.524325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:54.525096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:54.525534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:54.555823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2da3ef1f-7341-4ba7-9bd8-98aa1bdc97be tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Jul 11 15:54:54.556429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 324/637] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:54.680360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:54.681401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:54.689815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:54.690266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:54.691025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:54.691458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:54.850310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:54.857991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96ad529b-9fde-4a75-9078-b89da38756c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.184192 Jul 11 15:54:54.858552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 314/638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:55.572005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:55.573553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:55.585147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:55.585897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:55.587153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:55.587879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:55.619600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c26e493-75c0-44fb-b2cb-6cb273f9fcc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054331 Jul 11 15:54:55.620184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 325/639] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:55.879211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:55.880221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:55.891094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:55.891554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:55.892319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:55.892781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:56.027079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:56.037723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0bbfd00-4aa2-48e4-a66a-5c7fafe8af83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.164875 Jul 11 15:54:56.038662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 315/640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:56.633027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:56.634090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:56.642073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:56.642513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:56.643262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:56.643687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:56.673056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ebe8a93-99c1-49d7-b612-13fb3f6e3474 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044768 Jul 11 15:54:56.673604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 326/641] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:56.781117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:54:56.781320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 15:54:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:54:57.061002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:57.061964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:57.069303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:57.069755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:57.070619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:57.071016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:57.172666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-3f8d4fae-42ca-49d8-939b-a5ff98e9dcef req-6b9557c0-1394-4144-a873-258d7c176227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc150a1-4fb4-44a9-8bbc-641cb207d92f", "name": "network-vif-unplugged", "status": "completed", "tag": "49cb686e-832f-4279-9d17-2a934de0cd7e"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:54:57.183717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-3f8d4fae-42ca-49d8-939b-a5ff98e9dcef req-6b9557c0-1394-4144-a873-258d7c176227 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:57.184785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-3f8d4fae-42ca-49d8-939b-a5ff98e9dcef req-6b9557c0-1394-4144-a873-258d7c176227 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:57.201469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-3f8d4fae-42ca-49d8-939b-a5ff98e9dcef req-6b9557c0-1394-4144-a873-258d7c176227 service nova] Creating event network-vif-unplugged:49cb686e-832f-4279-9d17-2a934de0cd7e for instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f on hv-cinder-79760 Jul 11 15:54:57.206655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-3f8d4fae-42ca-49d8-939b-a5ff98e9dcef req-6b9557c0-1394-4144-a873-258d7c176227 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038076 Jul 11 15:54:57.207737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 327/642] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:54:57.211145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:57.218881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-34f920af-3d76-4844-9db4-bda9e7e5e952 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.164558 Jul 11 15:54:57.219436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 316/643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:57.688228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:57.689259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:57.695799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:57.696253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:57.697047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:57.697484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:57.701399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:57.733191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c4c31ae-6397-47f8-9bfa-9c007f54f639 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050883 Jul 11 15:54:57.733759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 328/644] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:58.237227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:58.237901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:58.245931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.246441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.247275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.247790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.398554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:58.406787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd413dfe-c1a9-4c08-b45d-94962f76c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.175038 Jul 11 15:54:58.407390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 317/645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:58.745443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:58.752224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:58.759006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.759450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.760341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.760704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:58.760836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.761331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:58.768733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.769248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.770072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.770592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.792076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ba70aa80-ea59-4208-907e-b14729515a2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050552 Jul 11 15:54:58.792899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 329/646] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:54:58.854056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lazy-loading 'services' on Instance uuid 61dce4e3-c747-471a-994d-8f005b95f31e {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:54:58.937763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-578abcb7-be32-4fa5-8b4a-0f5bce66a192 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments/8965e634-53e0-4871-8fa0-153c23212a1a" status: 202 len: 0 microversion: 2.1 time: 0.181121 Jul 11 15:54:58.938350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 318/647] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 15:54:58 2022] DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments/8965e634-53e0-4871-8fa0-153c23212a1a => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:54:58.948395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:58.949317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:58.955715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.956175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.956957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:58.957389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:58.986992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d7ec58f-dabc-412f-8e5e-49a77377ea24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Jul 11 15:54:58.987532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 330/648] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:54:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:54:59.425886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:59.426576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:59.433542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:59.434002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:59.434750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:59.435187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:59.580540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:54:59.588580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-470f50fd-846c-4600-b121-4f2623dfad27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.168351 Jul 11 15:54:59.589169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 319/649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:54:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:54:59.808362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:54:59.809890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:54:59.817999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:59.818443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:59.819202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:54:59.819640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:54:59.851426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e87dff26-55c9-46ca-a70f-d9dc1d5cf2aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049789 Jul 11 15:54:59.851973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 331/650] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:54:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:00.000968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:00.001951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:00.008498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.008951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.009715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.010147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.041720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7e032e87-5303-4843-b976-864a4b4d71ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jul 11 15:55:00.042275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 320/651] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:54:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:00.609715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:00.610756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:00.620936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.621674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.622909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.623631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.763278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:00.775886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0106e420-8501-4cac-8c94-43a0201c9365 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.172520 Jul 11 15:55:00.776862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 332/652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:00.867539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:00.868899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:00.878516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.878963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.879721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:00.880151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:00.896814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:00.911542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d92dff68-b937-4eed-b4f0-85ddc3286545 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050983 Jul 11 15:55:00.912101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 321/653] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:01.057564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:01.059190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:01.070281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.071019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.072228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.073026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.100997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-905881229"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:55:01.101504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:01.106079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cd4ec8a9-c2c3-4fb1-a583-aa660784d5ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055301 Jul 11 15:55:01.106831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 333/654] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:01.107775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.108225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.109016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.109454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.240172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.network.security_group_api [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Removing security group bf752da4-994b-4c4b-8d20-fe9ebc405e61 from port 1dde6cf4-4caa-44b8-937b-986dee3f0852 Jul 11 15:55:01.615157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d12e59a-1813-4739-b910-bd5a6fe3481b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action" status: 202 len: 0 microversion: 2.1 time: 0.518149 Jul 11 15:55:01.619057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 322/655] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 15:55:01 2022] POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:55:01.632379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-d0261ca0-98b0-4e9d-8e07-f2aa00c937df req-e3b820c4-4747-4ce7-bc23-3f95f95807e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:55:01.637869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d0261ca0-98b0-4e9d-8e07-f2aa00c937df req-e3b820c4-4747-4ce7-bc23-3f95f95807e1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.638296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-d0261ca0-98b0-4e9d-8e07-f2aa00c937df req-e3b820c4-4747-4ce7-bc23-3f95f95807e1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.652895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-d0261ca0-98b0-4e9d-8e07-f2aa00c937df req-e3b820c4-4747-4ce7-bc23-3f95f95807e1 service nova] Creating event network-changed:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:55:01.662010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-d0261ca0-98b0-4e9d-8e07-f2aa00c937df req-e3b820c4-4747-4ce7-bc23-3f95f95807e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 Jul 11 15:55:01.680825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 334/656] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:01.806620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:01.809328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:01.816877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.817358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.818398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.820516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.930193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:01.931436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:01.938935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.939698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.940613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:01.941293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:01.975497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2bb8ba6-f79a-498f-97a5-c4d219c16dab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055232 Jul 11 15:55:01.976606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 335/657] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:55:02.084725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:02.094195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-031e180d-e51d-4471-ba3f-de7a4a1d3d5b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.301797 Jul 11 15:55:02.095344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 323/658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:02.118622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:02.119702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:02.126186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.126637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:02.127396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.127826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:02.158978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bb7b6456-ae22-4fc2-a950-32aecd706118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Jul 11 15:55:02.159525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 336/659] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:02.846773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:02.847269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:02.853542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.853987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:02.854714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.855168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:02.937501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lazy-loading 'services' on Instance uuid 16771e46-eae0-460a-9353-dbcfdb1338d1 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 15:55:02.987563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:02.988582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:02.995808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.996279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:02.997086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:02.997531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.015359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be5e34c4-2e44-46da-95bf-70e10d579d04 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3" status: 202 len: 0 microversion: 2.1 time: 0.172412 Jul 11 15:55:03.015739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 324/660] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 15:55:02 2022] DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 15:55:03.024222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:03.025464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:03.032755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.033001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2bbacfea-4d6f-4bf5-9e9d-a4041050e9f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049086 Jul 11 15:55:03.033463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.037598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 337/661] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:03.037792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.037792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.064983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3a6dd4f-aea8-4f78-b460-185336d2e80b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Jul 11 15:55:03.065564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 325/662] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:03.111743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:03.112392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:03.118579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.119091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.119848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.120335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.170807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:03.172554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:03.178657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.179016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.179779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.180191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.214865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4ace16c-ca6e-4c7f-86d4-39a78736cc2e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 Jul 11 15:55:03.215699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 326/663] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:03.266296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:03.274119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2983b440-ae16-49e7-aae0-3cad46aa526d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.166764 Jul 11 15:55:03.274804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 338/664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:03.686736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-ef43da6a-2c4c-4940-8298-729ec37f0673 req-856647a6-7be8-4d16-b7bd-c8417c4362c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:55:03.695752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-ef43da6a-2c4c-4940-8298-729ec37f0673 req-856647a6-7be8-4d16-b7bd-c8417c4362c3 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:03.696188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-ef43da6a-2c4c-4940-8298-729ec37f0673 req-856647a6-7be8-4d16-b7bd-c8417c4362c3 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:03.707073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-ef43da6a-2c4c-4940-8298-729ec37f0673 req-856647a6-7be8-4d16-b7bd-c8417c4362c3 service nova] Creating event network-changed:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 15:55:03.712319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-ef43da6a-2c4c-4940-8298-729ec37f0673 req-856647a6-7be8-4d16-b7bd-c8417c4362c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029186 Jul 11 15:55:03.712929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 327/665] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:04.046526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:04.048164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:04.056740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.057436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.058337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.059014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.078129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:04.079237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:04.087537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.087987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.089008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.089447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.091228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6b923179-905d-4285-8caf-c98f670e9b60 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049718 Jul 11 15:55:04.091797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 339/666] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:04.118205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e7e170bf-f9ad-4cc8-8152-62e31d41be2d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Jul 11 15:55:04.118776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 328/667] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:04.226780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:04.227696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:04.234267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.234810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.235579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.236009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.266361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2a43842-e5be-465a-be12-e84a9840a74e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jul 11 15:55:04.266845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 340/668] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:04.293821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:04.294419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:04.301666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.302121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.302883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:04.303319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:04.440539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:04.448691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e20bd346-7b71-4e56-bd99-9be0bda00187 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.161193 Jul 11 15:55:04.449276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 329/669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:05.105474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:05.106578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:05.114571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.115099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.115984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.116732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.130108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:05.131077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:05.137912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.138361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.139123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.139557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.148350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b01f970b-c8b0-41e0-8345-0f72babc54b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047997 Jul 11 15:55:05.149180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 341/670] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:05.169884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-72f2556e-8454-409c-b45b-74a76678e6c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Jul 11 15:55:05.170421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 330/671] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:05.282039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:05.283039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:05.289922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.290389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.291179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.291629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.322471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3cd24cc1-36aa-4c76-bb30-b478bc36c3f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047465 Jul 11 15:55:05.323013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 342/672] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:05.468060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:05.468856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:05.476785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.477341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.478291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:05.478834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:05.612313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:05.620589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-22ab56f8-37ae-4722-a6c8-89dd51e53ccb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.157485 Jul 11 15:55:05.621170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 331/673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:06.165376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:06.166724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:06.177277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.177738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.178723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.179375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.184924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:06.185899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:06.193378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.193827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.194646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.195073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.213120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d5a9e14c-0839-4dcb-b44a-6a510d805d49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054810 Jul 11 15:55:06.213669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 343/674] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:06.226380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56b052c2-c851-4f2f-9a0c-96f92855cda5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046671 Jul 11 15:55:06.226938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 332/675] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:06.339192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:06.340722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:06.351137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.351876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.353288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.354013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.386121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d2997d46-5f45-435e-a52f-a5811cbb6806 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053958 Jul 11 15:55:06.386673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 344/676] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:06.642061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:06.643063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:06.653268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.654002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.655242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:06.655962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:06.800171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:06.812248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-179f7e68-7c14-4159-abb0-173d197aada7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.176690 Jul 11 15:55:06.812925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 333/677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:07.229474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:07.230752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:07.238000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.238457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.239155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:07.239300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.239751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.240087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:07.246408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.246849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.247595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.248030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.256638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:07.269866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-828ec209-cf4d-4f5c-8ff3-0b1d8c6bd4b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047132 Jul 11 15:55:07.270444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 345/678] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:07.278999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ae8dcdb2-14ff-452e-acf7-55792692e4d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Jul 11 15:55:07.279554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 334/679] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:07.402047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:07.403550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:07.411381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.411839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.412644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.413089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.442897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4f75ea4f-fec4-4d5c-9337-40afe97622e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 Jul 11 15:55:07.443451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 346/680] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:07.832175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:07.832816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:07.839771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.840227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.841003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:07.841452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:07.973518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:07.985794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b3b15869-c390-401b-9165-d8223a8e15ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.158466 Jul 11 15:55:07.986366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 335/681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:08.285336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:08.286713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:08.292026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:08.293255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:08.295147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.295710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.296740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.297265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.302088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.302646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.303591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.304121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.330077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-803cb6ca-19b6-4366-aae7-d63f6fe50041 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050647 Jul 11 15:55:08.330640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 347/682] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:08.336281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-71eabdda-c60b-491d-b22f-3f7e1a9b4329 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049227 Jul 11 15:55:08.336876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 336/683] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:08.457473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:08.458647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:08.464993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.465439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.466197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:08.466635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:08.496031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-223a7301-9f5a-44d0-844b-a777f0a6e4e0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Jul 11 15:55:08.496695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 348/684] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:09.006560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:09.007443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:09.017211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.017882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.019025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.019648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.163047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:09.174525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24e3ee2b-5962-4f7a-bd71-68924e7a31bc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.174627 Jul 11 15:55:09.175063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 337/685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:09.343982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:09.345648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:09.349617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:09.350864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:09.354549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.355277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.356312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.356900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.360100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.361019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.361790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.362225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.379393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:09.388158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7ff75e7-ac27-4a4f-b46b-58405d58f331 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049709 Jul 11 15:55:09.388744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 349/686] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:09.393043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56afe079-f77e-4aee-842b-0e6fed820efd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049293 Jul 11 15:55:09.393609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 338/687] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:09.512892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:09.514242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:09.521853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.522324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.523094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:09.523536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:09.554184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b6084417-d624-47d3-aec5-50af08abea78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048489 Jul 11 15:55:09.554741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 350/688] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:10.197864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:10.198869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:10.208595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.209046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.209843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.210270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.351038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:10.364782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32320012-09fe-422b-990d-590eb1badbee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.173730 Jul 11 15:55:10.365625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 339/689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:10.405068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:10.406529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:10.407525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:10.408546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:10.411311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=74 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:10.413989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.414494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.415257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.415382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.415687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.415796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.416495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.416924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.445122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0de3ba49-41ed-4b4d-8861-b4d7d2678c03 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046912 Jul 11 15:55:10.445803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 351/690] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:10.446841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95b9131e-5c7e-44e8-a595-b56773e7203f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Jul 11 15:55:10.447418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 340/691] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:10.568775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:10.569973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:10.577303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.577801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.578645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:10.579121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:10.611669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e23d8b4f-66f4-4283-80a4-440dfc27b6dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048051 Jul 11 15:55:10.612216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 352/692] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:11.382606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:11.383239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:11.390224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.390665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.391419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.392017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.457275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:11.458551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:11.465086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.465521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.466274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.466697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.505262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d4508dfe-152c-4580-bae0-1ec3f9a4b79c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052236 Jul 11 15:55:11.505822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 353/693] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:55:11.510398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:11.511299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:11.517247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.517659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.518438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.518865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.534819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:11.545548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f2d061ff-8c03-44a7-a5f3-29af8c5df49a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.166822 Jul 11 15:55:11.546121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 341/694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:11.547964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf947082-54fd-4fc3-b58f-c822a30d31a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Jul 11 15:55:11.548690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 354/695] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:11.627456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:11.629000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:11.639279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.639926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.641231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:11.642177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:11.672497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af05ac9c-74ab-4e5b-82eb-0685823267ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051578 Jul 11 15:55:11.673109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 342/696] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:12.522124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:12.523670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:12.535767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.536215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.537105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.537630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.559795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:12.560759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:12.567312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.567757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.568189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7266da4a-dfef-4962-8069-f6e33f87e2e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053374 Jul 11 15:55:12.568771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.568903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 355/697] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:12.569206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.573406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:12.574011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:12.579814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.580271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.581060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.581484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.598981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1fdec3d1-3c3f-49a1-815b-b31748d25dd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jul 11 15:55:12.599727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 343/698] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:12.685358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:12.686439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:12.693190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.693633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.694393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:12.694818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:12.720879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:12.724437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6df84391-8cdb-46ad-a4dc-02748c6f9ffb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Jul 11 15:55:12.725202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 344/699] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:12.728999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05f29d3a-a8aa-4161-b0b7-5b42bdc93607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.159228 Jul 11 15:55:12.729553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 356/700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:13.581557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:13.583444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:13.590510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.590954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.591708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.592140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.610827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:13.611777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:13.618679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.619134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.619889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.620321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.623985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1171b064-583b-43d7-a1a3-b54d20052e38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046509 Jul 11 15:55:13.624591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 345/701] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:13.650041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f12cda08-826b-4bf5-8d62-90e03fb6d0d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Jul 11 15:55:13.650596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 357/702] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:13.736543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:13.737501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:13.744846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.745447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.746589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.747171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.747320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:13.748059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:13.757145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.757741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.758893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:13.759521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:13.783648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-54836f23-9097-47d5-9f2e-03b1b51c9b7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051143 Jul 11 15:55:13.784280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 346/703] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:13.895488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:13.903270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5e510282-c6b4-4e1f-8f86-ea403e4dd4ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.161116 Jul 11 15:55:13.903840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 358/704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:14.640642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:14.642130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:14.650220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.650671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.651430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.651861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.662163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:14.663083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:14.669971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.670418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.671172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.671602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.682502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2af7f024-ce65-4e00-b1b2-0afa8482bf49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048727 Jul 11 15:55:14.683075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 347/705] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:14.700950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7b0ef81-79ea-48e0-a598-21b29d907cb8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Jul 11 15:55:14.701496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 359/706] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:14.799658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:14.801323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:14.811864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.812682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.813949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.814677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.845936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d35585e9-e7b8-4d56-8b91-fd7e0839b864 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053024 Jul 11 15:55:14.846499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 348/707] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:14.921599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:14.922208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:14.928862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.929298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:14.930058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:14.930489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.068355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:15.078048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-347f0a73-a6b7-4933-a357-f6f0039f31cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.159910 Jul 11 15:55:15.078385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 360/708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:15.697498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:15.698566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:15.707017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.707514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.709297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.709753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.713875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:15.714895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:15.722463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.722953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.723846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.724274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.741642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b7ce53c-9b09-4285-acf0-807e6732f686 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049793 Jul 11 15:55:15.742222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 349/709] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:15.754543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-325aa3f4-7f12-41d2-888b-fbecf1179e1a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jul 11 15:55:15.755677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 361/710] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:15.862348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:15.864066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:15.870872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.871358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.872112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:15.872583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:15.903573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e42dcd9-b0ef-4814-9786-4edc111d636e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048146 Jul 11 15:55:15.904118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 350/711] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:16.096250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:16.097000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:16.105033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.105551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.106960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.106960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.111588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:16.255086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:16.263956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f8b906fc-f046-4d51-9fc7-cadaa29edb27 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.172348 Jul 11 15:55:16.264564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 362/712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:16.758417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:16.759932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:16.770826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.771248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.771525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:16.771981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.772480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.772637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:16.779352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.779807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.780606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.781041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.802294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12a033e2-ed61-467e-a26f-3dfae60686fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050578 Jul 11 15:55:16.803092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 351/713] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:16.811715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d9b4d54-00eb-4db9-8c4e-cea34cb9743d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047445 Jul 11 15:55:16.812269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 363/714] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:16.920703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:16.922084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:16.930010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.930448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.931202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:16.931628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:16.961333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-744e0d4a-ffd3-4ed0-8f53-b1503e9dfaf3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Jul 11 15:55:16.961913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 352/715] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:17.282914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:17.283635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:17.291105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.291548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.292327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.292766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.432678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:17.440524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-020fd5c2-63c2-4173-bf8d-def1855b1af8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.162150 Jul 11 15:55:17.441075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 364/716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:17.817813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:17.818899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:17.825478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:17.826562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:17.826954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.827492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.828475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.828983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.834767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.835315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.836222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.836775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.862299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5cb0444-a38e-4961-8373-c35ba8bb7929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051241 Jul 11 15:55:17.862876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 353/717] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:17.868805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4ff4d49-f203-4fc7-bd13-44e04850fed0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Jul 11 15:55:17.869374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 365/718] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:17.976321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:17.977254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:17.985474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.986295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:17.987466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:17.988095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.024482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d59c5517-0e61-4011-8f4a-f9e11c48fdf4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053689 Jul 11 15:55:18.025042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 354/719] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:18.463542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:18.464068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:18.470514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.470964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.471729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.472158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.868644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:18.876670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42421a33-9fa8-4edf-908d-15a8e019466b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.417182 Jul 11 15:55:18.877285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 366/720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:18.882610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:18.883525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:18.888486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:18.890168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.890646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.891428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.891861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.918501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:18.919023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:18.924566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9647d821-6bfb-4240-b073-689819c37bb3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046138 Jul 11 15:55:18.925044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.925146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 367/721] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:18.925820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.926817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.927298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.930218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:18.931136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:18.932050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:18.937385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.937835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.938587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:18.939013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:18.952634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29034a4d-6900-49b3-824d-e469f5705abc tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a/ips" status: 200 len: 146 microversion: 2.1 time: 0.095277 Jul 11 15:55:18.953245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 355/722] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 15:55:18 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a/ips => generated 146 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:18.968939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c9f130a-da46-4a86-9a50-180a9831f60a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Jul 11 15:55:18.969491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 368/723] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:19.036411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:19.037279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:19.043972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.044445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.045221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.045711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.075991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-db72abca-07a2-4069-886c-e96bb283f142 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Jul 11 15:55:19.076601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 356/724] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:19.894827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:19.895441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:19.902485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.902936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.903703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.904141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.939226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:19.940980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:19.948485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.948928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.949687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.950110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.981093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c240281e-e12f-4eaf-aed5-0cc144e46bc7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048059 Jul 11 15:55:19.981677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 357/725] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:19.986320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:19.987248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:19.993599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.994048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:19.994816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:19.995251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:20.024731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-375d754d-2532-4c85-a836-6cb7e373f996 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Jul 11 15:55:20.025308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 358/726] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:20.043016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:20.050883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-664c79f9-275f-4635-adcf-e0ba77775bae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.160152 Jul 11 15:55:20.051453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 369/727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:20.088899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:20.089750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:20.096188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:20.096666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:20.097418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:20.097847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:20.127086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8697bee-41b0-48b9-aa4c-4989af7675f8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jul 11 15:55:20.127634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 359/728] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:20.996461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:20.997556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:21.007835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.008428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.009540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.010106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.036678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:21.037779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:21.044784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.045230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.045986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.046411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.046734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7c692a8-2000-4bb3-af8b-09924c8064dc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057005 Jul 11 15:55:21.047297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 370/729] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:21.067519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:21.068339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:21.074683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.075191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.076085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.076677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.077617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-16b23c71-77fb-4a29-b629-1f1bcfd8edd8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Jul 11 15:55:21.078203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 360/730] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:21.140756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:21.141717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:21.148630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.149075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.149828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:21.150257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:21.180603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a08f4c59-958e-4b1d-85ca-cc0ed737f68e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Jul 11 15:55:21.181212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 361/731] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:21.214268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:21.222258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d635bea1-2cda-48b8-857e-29a9439f9df0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.158657 Jul 11 15:55:21.222828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 371/732] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:55:22.063724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:22.065340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:22.077114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.077981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.079693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.080474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.090775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:22.091954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:22.099101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.099566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.100323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.100798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.112676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8a4487b0-b0e1-4e8e-9932-8a024a98325f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056279 Jul 11 15:55:22.113454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 362/733] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:22.130210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-55918b09-9896-4a81-b4ac-2a2054af85be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Jul 11 15:55:22.130756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 372/734] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:22.195526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:22.196338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:22.203352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.203848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.205202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.205668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.239381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:22.239992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:22.243507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-07c29140-901e-40bb-8457-9c9ed5d33d52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054474 Jul 11 15:55:22.244080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 363/735] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:22.246552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.247007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.248080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:22.248696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:22.383975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:22.391656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d986202-3adc-4173-946d-b9bd8739a7c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.156194 Jul 11 15:55:22.392216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 373/736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:55:23.126638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:23.127735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:23.135491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.135949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.136719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.137194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.142015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:23.142944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:23.149655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.150096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.150848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.151280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.167291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0c38dd0-5f60-4ea8-93d3-be35ccc5c7b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045690 Jul 11 15:55:23.167867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 364/737] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:23.181292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-195ae691-c5f3-4236-abff-dbb9ce99f149 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Jul 11 15:55:23.181851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 374/738] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:23.255707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:23.256610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:23.263164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.263611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.264401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.264834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.295168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-65c5496e-750a-44a7-b887-12bf30a92352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Jul 11 15:55:23.295733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 365/739] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:23.409032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:23.409613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:23.415988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.416464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.417207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:23.417640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:23.556019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:23.567582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c1b7cf9-17a5-4ddb-99ac-8c89099dfcdd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.162062 Jul 11 15:55:23.568340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 375/740] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:24.184827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:24.186545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:24.196161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:24.198356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:24.199285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.200070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.201444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.202185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.210064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.210862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.211317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.211753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.236773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b02d689e-f330-468b-8130-721d93db0131 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059341 Jul 11 15:55:24.241095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 366/741] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:24.241960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0314645-277d-42d7-97fe-d1cb1f83ff70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052392 Jul 11 15:55:24.242527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 376/742] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:24.308742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:24.309634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:24.316019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.316502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.317289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.317720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.348562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7629e94-3b73-49c9-9942-ed3aa2996b43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Jul 11 15:55:24.349178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 367/743] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:24.594302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:24.595328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:24.603178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.603617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.604445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:24.604878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:24.743792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:24.751834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f053d38-4e81-490c-b212-73a6952d637c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.164151 Jul 11 15:55:24.752473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 377/744] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:25.249923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:25.250838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:25.253502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:25.254422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:25.258202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.258640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.259410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.259869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.261121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.261572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.262334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.262759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.288779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:25.290719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bab58e14-fadc-4993-bf18-19b0910897fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045016 Jul 11 15:55:25.293988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cdd2098c-2ffe-420c-a6f4-8c15291f321e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jul 11 15:55:25.294718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 378/745] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:25.295066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 368/746] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:25.364383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:25.365886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:25.376325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.377374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.378336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.379061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.410178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-08a2694d-e026-42c5-a4cd-64fb49e3c767 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052528 Jul 11 15:55:25.410732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 379/747] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:25.773604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:25.774228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:25.781786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.782318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.783215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:25.783730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:25.922735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:25.934400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a5fa0868-c292-4f1b-b26e-92ef03ad46f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.167445 Jul 11 15:55:25.935203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 369/748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:26.307376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:26.307987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:26.308403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:26.308749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:26.315506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.315699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.315953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.316155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.316748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.317010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.317152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.317445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.348307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7dc1bcb9-47d3-4881-9b50-4fe267783ae5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Jul 11 15:55:26.348907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 370/749] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:26.349917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d6f507f-b65c-46a1-80c3-bd564a444ac6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049228 Jul 11 15:55:26.350497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 380/750] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:26.425920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:26.427416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:26.435377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.435837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.436615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.437186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.466842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32d31120-21f7-40e1-a1ac-4ae5fb9f914b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047429 Jul 11 15:55:26.467402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 371/751] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:26.959021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:26.960031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:26.970807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.971573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:26.981522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:26.982440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.125849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:27.137382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d50dbf56-e509-4a5b-b30a-d4c150c5c764 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.184917 Jul 11 15:55:27.138145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 381/752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:27.365907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:27.366972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:27.367618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:27.367771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:27.378359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.378802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.379056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.379604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.380349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.380911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.381146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.381637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.386231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:27.412467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-30859505-7866-4f7b-8d4b-010803a27b88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053131 Jul 11 15:55:27.412900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3500a49f-8889-4f72-aed9-f0cdb378f330 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053658 Jul 11 15:55:27.413012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 382/753] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:27.413480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 372/754] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:27.480242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:27.481193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:27.487593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.488035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.488819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:27.489246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:27.519934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91670eff-8d87-4ed4-9f6a-0e80289a7a40 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Jul 11 15:55:27.520511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 383/755] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:28.163168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:28.164282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:28.171865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.172339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.173184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.173665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.313419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:28.324637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9135c281-2af7-4bf7-af7b-df9ee059ef39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.167897 Jul 11 15:55:28.325204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 373/756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:28.428591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:28.429423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:28.430013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:28.431246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:28.441834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.442967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.444351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.444816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.445103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.446412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.446802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.446924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.479558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95a437ef-eeab-4f4e-9b3a-12be154c7eea tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056863 Jul 11 15:55:28.479796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3dff1af-77a2-4af2-b426-3eb7872146cd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057687 Jul 11 15:55:28.480362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 374/757] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:28.485957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 384/758] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:28.534642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:28.535821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:28.544955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.545400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.546390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:28.546890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:28.578080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a846fcd1-da6e-4945-9a68-81ce98d21e05 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Jul 11 15:55:28.578625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 375/759] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:29.346343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:29.347344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:29.357924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.358677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.359939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.361194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.491446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:29.492511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:29.499608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.500059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.501208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.501921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.506343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:29.515611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-38bca3c8-73a8-4660-b8e0-e8e7fff5cb7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.176600 Jul 11 15:55:29.516273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 385/760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:29.521339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:29.522441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:29.531691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.532135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.532928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.533078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aa6f4c9d-115b-4e8f-89e7-241ad233f484 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045752 Jul 11 15:55:29.533442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.533856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 376/761] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:55:29.562292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50daf42b-e69e-4490-bf7e-3b73299c60d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Jul 11 15:55:29.562842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 386/762] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:29.593734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:29.595281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:29.604951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.605328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.606083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:29.606512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:29.636433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f74d0b25-cae9-4b24-a341-c8a72177b612 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Jul 11 15:55:29.636976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 377/763] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:30.538291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:30.538949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:30.546464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:30.546943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.547115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.548066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.548331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.549017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:30.555569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.556018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.556812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.557289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.588929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b1615f0c-e870-4fba-bd5d-e71eab9e1d5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046182 Jul 11 15:55:30.589503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 378/764] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:30.594455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:30.595443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:30.601999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.602482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.603309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.603832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.633711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-facf864d-4271-470c-9472-8a311919af8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Jul 11 15:55:30.634315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 379/765] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:30.647095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:30.648119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:30.654860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.655320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.656108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:30.656556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:30.684623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:30.685991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6e24e100-4280-4139-b174-a5907546cfaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042843 Jul 11 15:55:30.686566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 380/766] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:30.692309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab6e5e86-9707-46b1-bc18-983792d4d3af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.161500 Jul 11 15:55:30.692886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 387/767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:31.600576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:31.601529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:31.608736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.609191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.609950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.610378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.639203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d7ca8649-cb1b-49f9-a905-9b9e24b9d929 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042635 Jul 11 15:55:31.639744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 381/768] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:31.647015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:31.648167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:31.656007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.656521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.657301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.657731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.687063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ffc5117-4bd9-4387-a0cc-48dbffcabc13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Jul 11 15:55:31.687630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 388/769] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:31.696925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:31.697857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:31.704063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.704520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.705272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.705703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.709697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:31.710302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:31.716686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.717140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.717902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:31.718324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:31.743254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2b9d3e4-869e-49b7-b271-70908700db58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050231 Jul 11 15:55:31.743788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 382/770] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:31.851361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:31.860176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c520846-dc6f-4f0b-bbc7-2bf3741c27b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.154693 Jul 11 15:55:31.860810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 389/771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:32.654755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:32.656186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:32.666626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.667242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.668320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.669182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.698954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:32.699978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:32.700626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5ba5fc3e-e93a-4e69-96f8-ee7debee6eb7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052276 Jul 11 15:55:32.701192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 383/772] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:32.709016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.709464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.710236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.710673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.741056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b2ae202-015f-451e-9c3b-28fdd93020e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Jul 11 15:55:32.741612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 390/773] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:32.755218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:32.756175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:32.762698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.763405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.764166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.764620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.793281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-efec5d12-1c7a-4bc3-b672-e15aa1f80858 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Jul 11 15:55:32.793884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 384/774] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:32.879705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:32.880519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:32.888938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.889503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:32.890457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:32.891046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.040085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:33.053065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c5f59690-150c-4cac-b16b-6497c6ae60f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.178126 Jul 11 15:55:33.053824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 391/775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:33.716239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:33.717197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:33.730170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.730619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.731447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.731853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.753120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:33.754035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:33.760624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.761071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.761478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9615953-93d4-4552-bac0-9202e83f87b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051975 Jul 11 15:55:33.761827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.762244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.762400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 385/776] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:33.796165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c393430-aa60-4423-8000-6de07700982e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Jul 11 15:55:33.796971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 392/777] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:33.807099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:33.808020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:33.814689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.815135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.815995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:33.816513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:33.845921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15a2a3aa-a62a-4167-a2e9-a03585dab5e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Jul 11 15:55:33.846410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 386/778] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:34.073916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:34.074643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:34.082093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.082541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.083616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.084048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.224334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:34.232720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cde2934c-d6e0-46c9-a55a-9d22556a0030 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.164266 Jul 11 15:55:34.233335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 393/779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:34.777394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:34.778904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:34.789769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.790506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.791739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.792497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.808627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:34.809700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:34.817167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.817645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.818379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.818841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.822674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-003870e8-8850-45d9-99e4-257cb875a7d2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052066 Jul 11 15:55:34.823251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 387/780] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:34.850350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0f717913-cfc0-4ec5-a798-630c34402ff3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Jul 11 15:55:34.850899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 394/781] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:34.857473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:34.858404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:34.864613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.865062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.865811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:34.866243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:34.891764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:34.896778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8bd0fc58-8f0a-4429-9d47-2659245b2cc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Jul 11 15:55:34.897341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 388/782] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:35.251831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:35.252670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:35.261131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.261728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.262721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.263649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.285229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:35.408925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:35.420585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54b5f653-513d-4951-9ed7-942d2fc03e46 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.173924 Jul 11 15:55:35.421329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 395/783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:35.836623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:35.837752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:35.846781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.847312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.848422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.848895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.862042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:35.862978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:35.870114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.870573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.871341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.871785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.883234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-426c2462-ab58-4e45-9cbc-3b2835b8afca tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052402 Jul 11 15:55:35.883808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 389/784] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:35.901565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c866f53a-8fdc-42e4-9d13-e8b34a5c0074 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Jul 11 15:55:35.902131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 396/785] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:35.911854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:35.913282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:35.915832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:35.924065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.924674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.925735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:35.926346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:35.959970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49a08a34-1e49-4a2e-8a44-b3c0f05ee0d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054056 Jul 11 15:55:35.960596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 390/786] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:36.446998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:36.447874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:36.455331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.455778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.456568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.457002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.593889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:36.605414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28169966-7fb2-4419-b8e9-0c7479530b6b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.164812 Jul 11 15:55:36.606198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 397/787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:36.899403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:36.900877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:36.908790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.909241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.909981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.910409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.913528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:36.914462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:36.921624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.922079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.922852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.923290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.940976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64a35318-b057-4d1d-9b88-68af4b71b5ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048317 Jul 11 15:55:36.941765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 391/788] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:36.954010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16013273-6bc7-4fd6-a320-fc3e51aadd75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Jul 11 15:55:36.954549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 398/789] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:36.971538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:36.972526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:36.978656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.979100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:36.979848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:36.980276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.008968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-810ecdd1-4592-4015-b34e-919daa5bead7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Jul 11 15:55:37.009411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 392/790] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:37.627384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:37.628370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:37.638621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.639357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.640655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.641369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.786323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:37.794223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c973010d-eabb-4a75-b355-50562190ce04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.173613 Jul 11 15:55:37.794771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 399/791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:37.955817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:37.956892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:37.967120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.967391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:37.967941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.968389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:37.968709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.969174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.977081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.977645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:37.978590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:37.979133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:38.001399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba19a6ca-6202-4a7e-8cd6-0c516bb8f3ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050937 Jul 11 15:55:38.002000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 393/792] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:38.009353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2777325b-7df0-4825-88c8-62ca2e5a79c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Jul 11 15:55:38.009909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 400/793] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:38.020339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:38.021294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:38.027282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:38.027717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:38.028520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:38.028949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:38.057119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc04274a-ad4b-4848-a8f2-54f7e32b008e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Jul 11 15:55:38.057653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 394/794] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:38.812772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:38.813382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:38.819924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:38.820324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:38.821129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:38.821564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:38.952593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:38.960611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17b927b3-69d3-4982-9ec4-cad09bfbc1c8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.152018 Jul 11 15:55:38.961186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 401/795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:39.013163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:39.014227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:39.021216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:39.021697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.021697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.022140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:39.022445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.022891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.028863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.029301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.030405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.030850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.052255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9ec2b74d-4deb-4336-9124-68343a67784e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043114 Jul 11 15:55:39.052865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 395/796] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:39.060238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3a912ff0-7dfb-4087-92a8-cebd7b924019 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Jul 11 15:55:39.060833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 402/797] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:39.070464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:39.071360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:39.077788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.078240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.079045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.079500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.109965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66fb3ad2-16dd-484d-bfd1-265064c1fbf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Jul 11 15:55:39.110536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 396/798] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:39.980936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:39.981793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:39.991039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.991682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:39.992800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:39.993409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.064168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:40.066458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:40.071472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.071915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.072714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.073144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.106281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-79f5e50e-6c15-45ce-9a17-4d22b1048222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046804 Jul 11 15:55:40.106761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 397/799] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:40.111284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:40.112188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:40.117997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.118441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.119190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.119622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.130289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:40.138020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44d0f511-b691-4ac0-9c6f-7a8ff97e0cad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.162654 Jul 11 15:55:40.138590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 403/800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:40.143329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:40.144257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:40.149444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdb57e05-4e4d-4ca2-bcdb-5e9bb6d5c6bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Jul 11 15:55:40.149963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.150319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 398/801] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:40.150447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.151136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:40.151572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:40.180299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93b5c2b7-86cd-4333-b517-f5fad7c1f33a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040707 Jul 11 15:55:40.180878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 404/802] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:41.122014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:41.123508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:41.130582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.130957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.131710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.132139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.155409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:41.156271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:41.162522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-85009551-cab1-4559-b41c-341b0f5e3a19 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047105 Jul 11 15:55:41.162968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.163106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 399/803] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:41.164214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.164214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.164730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.170169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:41.171078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:41.177108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.177523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.178264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.178691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.208682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc83f2a2-868b-4b53-9291-dd276046a8e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Jul 11 15:55:41.209295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 400/804] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:41.214017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:41.214933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:41.221052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.221619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.222386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:41.222852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:41.252311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0171f0cc-433a-421c-b2c7-4d442d8da173 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041954 Jul 11 15:55:41.252855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 401/805] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:41.303234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:41.310909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-868f42b0-5090-44ae-b32f-4eb76c54a790 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.159551 Jul 11 15:55:41.311713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 405/806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:42.174965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:42.175879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:42.183291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.183728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.184516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.184946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.216337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc59d09f-8f90-4478-8b2f-1e66f5bf4da8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045351 Jul 11 15:55:42.216824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 402/807] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:42.220587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:42.221647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:42.230728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.231162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.231919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.232445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.263314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a656153e-9528-4b3f-96e1-dbdf30b4d018 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Jul 11 15:55:42.264419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 406/808] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:42.265115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:42.266249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:42.272511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.272946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.273707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.274132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.304556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c073a5f-00cb-42d7-a583-96ad05d803a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Jul 11 15:55:42.305117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 403/809] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:42.332609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:42.333575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:42.339778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.340231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.341023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:42.341463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:42.479919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:42.487788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2b266fc1-43d7-47df-9afe-95f6575e1c25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.159133 Jul 11 15:55:42.488393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 407/810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:43.228927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:43.229774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:43.237462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.237910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.238665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.239097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.270134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4a22f4a5-911e-49e7-8ce4-0fb7d13749e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Jul 11 15:55:43.270937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 404/811] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:43.279077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:43.280645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:43.290168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.290735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.291776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.292364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.316904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:43.317803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:43.322920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b7342e6-d42c-401d-998d-4634379ef343 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049590 Jul 11 15:55:43.323495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 408/812] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:43.324063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.324561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.325309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.325740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.344510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:43.357488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f0772c99-1d3e-463a-9af2-02cba9d2bcb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Jul 11 15:55:43.358044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 405/813] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:43.505318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:43.505928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:43.512055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.512546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.513302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:43.513741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:43.656780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:43.664841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ab5802c-6479-4ef3-abd0-f0ef5e885bf1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.163445 Jul 11 15:55:43.665404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 409/814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:44.285626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:44.286862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:44.295822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.296461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.297679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.298263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.330498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15122b88-0228-4f71-b8a6-5f7337ca4abd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051134 Jul 11 15:55:44.332350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 406/815] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:44.335502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:44.336487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:44.343114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.343559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.345130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.345562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.369718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:44.370784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:44.374244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c205d916-b864-4e00-b048-41af84ebefd2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Jul 11 15:55:44.374799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 410/816] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:44.377411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.377856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.378604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.379030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.409294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e8bb6e4e-7367-424b-80f8-db34b6781b63 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Jul 11 15:55:44.409849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 407/817] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:44.686779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:44.688513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:44.698573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.699313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.700625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:44.701347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:44.843387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:44.851256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c90d87f3-7ecf-4af2-bbf5-3999b9b93ba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.171033 Jul 11 15:55:44.852020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 411/818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:45.343122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:45.343940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:45.351267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.351710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.352497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.352922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.382776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ffed8e5-52d0-4817-bc25-35a4155d2417 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043814 Jul 11 15:55:45.383328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 408/819] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:45.386514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:45.387696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:45.396247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.396717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.397475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.397899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.401553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:45.421141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:45.422071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:45.429026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.429441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-303ddf10-93a5-474e-bc10-b2f49473d88a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047124 Jul 11 15:55:45.429614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.429999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 412/820] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:45.430203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.430810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.469223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6361078d-e2a5-4638-b2a5-0ef146112bc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052048 Jul 11 15:55:45.469818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 409/821] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:45.875694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:45.876161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:45.883795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.884254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:45.885051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:45.885490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.211722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:46.220235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a62250f5-01de-44bc-9ee8-c1c9046dc7cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1578 microversion: 2.1 time: 0.348234 Jul 11 15:55:46.221078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 413/822] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1578 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:46.395487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:46.397341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:46.404985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.405414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.406582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.407066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.443488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:46.444469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:46.453480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-48a7065c-e516-481b-aade-8fd42d7712c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062187 Jul 11 15:55:46.454343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 410/823] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:46.459755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.460200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.461140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.461562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.481707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:46.482921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:46.490795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.491492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.492536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:46.493133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:46.507512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97d03f06-8e3b-4d21-bea4-86a069a90f5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067162 Jul 11 15:55:46.508886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 414/824] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:46.530712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9eb9acab-fbf1-4d64-8ce9-5262bbd08507 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053454 Jul 11 15:55:46.532433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 411/825] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:47.137353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-282a3c72-f62d-4204-a7f6-7f547e758ca9 req-2aa96d76-0f3c-4e96-8ae8-7d1602ee74a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc150a1-4fb4-44a9-8bbc-641cb207d92f", "name": "network-vif-deleted", "tag": "49cb686e-832f-4279-9d17-2a934de0cd7e"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 15:55:47.146048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-282a3c72-f62d-4204-a7f6-7f547e758ca9 req-2aa96d76-0f3c-4e96-8ae8-7d1602ee74a4 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.146485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-282a3c72-f62d-4204-a7f6-7f547e758ca9 req-2aa96d76-0f3c-4e96-8ae8-7d1602ee74a4 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.158333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-282a3c72-f62d-4204-a7f6-7f547e758ca9 req-2aa96d76-0f3c-4e96-8ae8-7d1602ee74a4 service nova] Creating event network-vif-deleted:49cb686e-832f-4279-9d17-2a934de0cd7e for instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f on hv-cinder-79760 Jul 11 15:55:47.163707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-282a3c72-f62d-4204-a7f6-7f547e758ca9 req-2aa96d76-0f3c-4e96-8ae8-7d1602ee74a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103155 Jul 11 15:55:47.164660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 415/826] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 15:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:47.240144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:47.241489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:47.255131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.261074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.262254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.262701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.363251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:47.378394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-649fec8f-fa03-46b5-a124-a8922905b33b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.143621 Jul 11 15:55:47.379177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 412/827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:47.466969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:47.468012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:47.475848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.476282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.477109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.477531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.511690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5079ce36-a6aa-4cf3-8106-14968807e90c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049664 Jul 11 15:55:47.512178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 416/828] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:55:47.519710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:47.520688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:47.527369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.527823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.528628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.529067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.543225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:47.545023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:47.551773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:47.553800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.554153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.555120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:47.555728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:47.567520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b04eba44-a837-4c75-bd8a-bad762725ad7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052197 Jul 11 15:55:47.571645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 413/829] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:47.592748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a6f406f4-3b86-4b1d-be00-e2b2168efa1c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053093 Jul 11 15:55:47.594102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 417/830] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:48.396086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:48.396758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:48.403500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.403951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.404745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.405176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.473860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:48.481686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70b7d080-652e-4f70-99ba-92389126998b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089494 Jul 11 15:55:48.482252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 414/831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:48.526880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:48.528226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:48.536782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.537226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.537993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.538420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.568654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c68630b2-f0ad-47c7-a1ce-551f876239b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048671 Jul 11 15:55:48.569214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 418/832] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:48.579430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:48.580394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:48.587719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.588167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.588956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.589397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.605854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:48.606745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:48.615609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.616351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.617594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:48.618300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:48.626058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4786a22-f903-407e-be50-22bfc22bdbbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050496 Jul 11 15:55:48.626605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 415/833] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:48.649333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8eae0773-d1ab-44eb-9359-575df76ab96e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Jul 11 15:55:48.649803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 419/834] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:49.502341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:49.502917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:49.510037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.510537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.511381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.511875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.577371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:49.581771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:49.582720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:49.586829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ec8de28-3951-470d-b5df-e1236d1b9265 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090745 Jul 11 15:55:49.588714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 416/835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:49.590016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.590465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.591238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.591671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.622560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8059e905-c8cc-47d4-bb3c-e66c429b1e92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 Jul 11 15:55:49.623120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 420/836] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:49.637636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:49.638562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:49.645370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.645812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.646556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.646983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.660590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:49.661511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:49.667720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.668167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.668961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:49.669401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:49.677072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c3c77d35-4862-4988-a12e-fbd13f70265a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Jul 11 15:55:49.677688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 417/837] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:49.700370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e4f5feaf-2947-43bd-bc7c-a5dd6f19d630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Jul 11 15:55:49.700928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 421/838] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:50.609190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:50.610280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:50.617304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.617756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.618516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.618945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.634391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:50.635315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:50.642560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.643008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.643773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.644189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.673560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14160742-55e9-4dab-85cf-15aaf1e3e980 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043105 Jul 11 15:55:50.674185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 422/839] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:50.683216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:50.689155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:50.690086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:50.690844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c399dd9-22a0-42f8-a020-44b0de092bd3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088537 Jul 11 15:55:50.691405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 418/840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:50.696128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.696611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.697367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.697798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.711864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:50.712823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:50.718697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.719231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.720058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:50.720528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:50.727537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7366d218-6805-4814-a2e8-2ede570f2970 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Jul 11 15:55:50.728105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 423/841] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:50.749531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-daef6bdb-4200-419e-8eeb-c4a3939d35ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Jul 11 15:55:50.750058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 419/842] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:51.689241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:51.690209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:51.697367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.697897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.698661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.699093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.706955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:51.707648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:51.714581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.715095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.715912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.716453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.729723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-55ac7f89-e934-4a62-a9a2-99e0d4c26cdb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046585 Jul 11 15:55:51.730503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 424/843] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:51.739278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:51.740210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:51.746129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.746581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.747335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.747765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.777711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-596335b9-4ec1-4159-a13f-8bf9bbcf3dba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Jul 11 15:55:51.778422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 425/844] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:51.778617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:51.783446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:51.784380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:51.787538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6adabb72-5c75-4bd2-989d-ed2d5b2bbe3a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084396 Jul 11 15:55:51.788107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 420/845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:55:51.790230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.790672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.791541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:51.791970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:51.820339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b9c581f0-ea26-496a-af2e-53ddac1c53a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040901 Jul 11 15:55:51.820915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 426/846] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:52.745692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:52.747831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:52.758465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.759196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.760529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.761241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.789108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:52.790044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:52.792654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa89d290-1e36-4973-bb7e-feec2f5cbac5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053713 Jul 11 15:55:52.793471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 421/847] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:52.797166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.797528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.798319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.798747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.804314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:52.804910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:52.811644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.812097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.812914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.813354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.817687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:52.829565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-36660e67-bee3-4b21-97e0-df463387df6a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jul 11 15:55:52.830144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 427/848] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:52.835106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:52.836040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:52.842054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.842503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.843256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:52.843681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:52.874085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98c41873-815a-470b-9b95-bca9b2905c0a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Jul 11 15:55:52.875095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 428/849] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:52.877475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:52.885638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-533a2760-5f9b-477c-9cc1-b168a8615dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085098 Jul 11 15:55:52.886197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 422/850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:53.808874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:53.810399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:53.818593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.819042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.819797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.820231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.837303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:53.841249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:53.842180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:53.849854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.850324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.851087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.851345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4dafc1b5-344f-4804-8a04-5adc3af2d0e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049130 Jul 11 15:55:53.851497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.851905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 429/851] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:53.882441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5d4fffa-057a-4d23-8ee7-2546c19cc402 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Jul 11 15:55:53.883007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 423/852] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:53.886751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:53.887822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:53.894095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.894543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.895385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.895833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.902602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:53.903208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:53.910292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.910741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.911500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:53.911931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:53.925188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52879f88-b98f-4f50-9266-73eedbd306b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Jul 11 15:55:53.925752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 430/853] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:53.977217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:53.985017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-75f1b06a-fce7-4ce3-9419-4f783d24eb82 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085975 Jul 11 15:55:53.985961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 424/854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:54.867946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:54.869459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:54.879156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.879628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.880416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.880857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.894570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:54.895594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:54.902652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.903097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.903858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.904329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.912702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1042ee96-0640-408c-a073-dacd48f23d7d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051395 Jul 11 15:55:54.913275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 431/855] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:54.934041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1bac368-9ba5-4abb-b553-6e59d9af628b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Jul 11 15:55:54.934604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 425/856] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:54.936727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:54.937682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:54.944391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.944839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.945600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:54.946033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:54.977081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-449c4cc2-782c-47d8-a25c-10a8cebdf3b6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Jul 11 15:55:54.977634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 432/857] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:55:55.002482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:55.003096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:55.009824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.010278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.011042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.011491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.095500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:55.103750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0dd74af-b3a3-4ff2-88c4-af2cee26ff7f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105305 Jul 11 15:55:55.104364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 426/858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:55.925708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:55.926558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:55.933544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.933998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.934761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.935210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.946515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:55.947488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:55.956198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.956736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.957650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.958529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.967942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d5e20662-85b1-4ead-9de3-afa2a284bd58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046471 Jul 11 15:55:55.968578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 433/859] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:55.988903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:55.989974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:55.991091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-67b12810-492d-432f-9ca8-7460ac89050f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Jul 11 15:55:55.991684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 427/860] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:55.996228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.996700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:55.997465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:55.997890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:56.028368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fe51ebec-429d-42bf-a30c-89a350b92f95 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 11 15:55:56.028921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 434/861] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:56.123863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:56.124646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:56.131660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:56.132096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:56.132879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:56.133302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:56.198880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:56.210527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f4fbdaf-f53a-4615-8a01-b3c227772280 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091237 Jul 11 15:55:56.211259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 428/862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:56.985353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:56.986904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:56.997778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:56.998521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:56.999769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.000608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.004966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:57.005920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:57.012654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.013096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.013848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.014277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.030935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b256156-bbdd-49d8-8900-240e95c28c1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052588 Jul 11 15:55:57.031615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 435/863] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:57.040142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:57.041079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:57.045100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-538d7f7b-8e7e-4075-829b-e2b415d313d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Jul 11 15:55:57.045686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 429/864] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:57.047336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.047785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.048568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.049002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.078935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-78ee58b3-6623-4502-ab6d-ce40f3699011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jul 11 15:55:57.079563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 436/865] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:57.227869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:57.228511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:57.235779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.236163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.236964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:57.237399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:57.307828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:57.316182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe4595a2-51e5-4f30-b913-56e9d9a1d370 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092137 Jul 11 15:55:57.316762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 430/866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:58.045668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:58.047260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:58.054810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.055241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.056002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.056463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.057141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:58.058067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:58.064983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.065440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.066199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.066633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.087032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d9bc7a52-c214-4b2e-9f25-7ddca7886743 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046699 Jul 11 15:55:58.087603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 437/867] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:58.092111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:58.093039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:58.096554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc4e904e-3e35-42f5-9b88-3347c9826be5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jul 11 15:55:58.097122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 431/868] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:58.099210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.099659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.100481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.100930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.129676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f2246018-74bb-4162-ace3-41a88a61ed96 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041120 Jul 11 15:55:58.130225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 438/869] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:58.337768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:58.338655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:58.347108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.347558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.348333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:58.348786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:58.416783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:58.424635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf69720a-0b5f-4f9b-9ca9-0d979ffa25e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093914 Jul 11 15:55:58.425204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 432/870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:55:59.099881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:59.100853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:59.107291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:59.107837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.108221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:59.108342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.109052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.109482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.115152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.115617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.116402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.116840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.138579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d4e7d1aa-4c65-4653-a879-229a66bd3ffa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042677 Jul 11 15:55:59.139145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 439/871] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:55:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:55:59.143688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:59.144617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:59.146391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7cdcbfb3-f78c-4c94-91f4-a9fb12c75a6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Jul 11 15:55:59.146944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 433/872] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:59.150488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.150931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.151683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.152109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.181037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3cf2cb61-e1af-4345-a339-f64eff3943b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 Jul 11 15:55:59.181593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 440/873] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:55:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:55:59.441686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:55:59.442323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:55:59.448764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.449625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.450359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:55:59.450810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:55:59.515588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:55:59.523352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e40b3cd-cc38-4165-8bff-ae2ddde48c36 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085680 Jul 11 15:55:59.523911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 434/874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:55:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:00.154711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:00.156093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:00.161095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:00.162029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:00.163648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.164105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.164932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.165370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.168885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.169336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.170101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.170536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.200325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea5bef41-7116-43fd-a0f2-b78d0f24d478 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052317 Jul 11 15:56:00.201122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 441/875] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:00.201574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8867c5c4-161a-4c74-9dd2-e516369e828c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Jul 11 15:56:00.202351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 435/876] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:00.205853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:00.206760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:00.213127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.213578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.214332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.214768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.243321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5f998321-ddc5-469d-b1ec-8ffe3f8b1dcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Jul 11 15:56:00.243869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 442/877] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:00.551177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:00.552169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:00.562440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.563581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.564387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:00.564823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:00.637293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:00.644924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10cef03b-f09a-47f8-bd33-02f2fa7a8ee1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101342 Jul 11 15:56:00.645488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 436/878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:01.213611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:01.214528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:01.216216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:01.217173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:01.221656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.222109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.222878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.223307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.224635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.225084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.225845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.226275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.254291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b638e4c-2655-4961-aa27-35e45432a9b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Jul 11 15:56:01.254989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 443/879] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:01.256533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d866d19-2d2e-40a9-93ee-ff756fcebec1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Jul 11 15:56:01.257270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 437/880] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:01.259779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:01.261104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:01.267581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.268037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.268826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.269256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.300390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-131ae553-ac93-4b13-9be3-a5dd83c2a7cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jul 11 15:56:01.300976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 444/881] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:01.666634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:01.667648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:01.676484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.676934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.677690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:01.678119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:01.746984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:01.750406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:01.755676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ad957c39-4c46-4ccf-b795-d24e25adf792 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095556 Jul 11 15:56:01.756215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 438/882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:02.270962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:02.271793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:02.272434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:02.273174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:02.281286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.282057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.282971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.283131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.283400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.283612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.284392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.284826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.314220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0dd5b4a7-d9a4-4f9f-83fc-a9020146d2b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050544 Jul 11 15:56:02.314491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d8c4f3a-3674-4710-9f32-99503c01f27e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049112 Jul 11 15:56:02.314779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 445/883] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:02.318163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 439/884] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:02.319663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:02.320605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:02.326440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.326896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.327651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.328089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.331770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:02.358359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-001ff08e-f8c3-4623-8d7f-8f309fb97ee6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 Jul 11 15:56:02.358892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 446/885] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:02.773929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:02.774600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:02.776635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:02.783319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.783753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.784540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:02.784972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:02.856012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:02.864559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-833c8f19-11fa-4526-b9d2-74b8638574dc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095018 Jul 11 15:56:02.865127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 440/886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:03.329849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:03.330446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:03.330815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:03.330930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:03.337972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.338165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.338424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.338589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.339179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.339321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.339606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.339757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.369094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93b00bfe-04fc-4c94-80a7-7c3d7f4c4cb4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 Jul 11 15:56:03.369656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 447/887] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:03.370850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca0b2a4c-a65c-4ac2-a4fd-285959c1c37f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047002 Jul 11 15:56:03.374800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 441/888] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:03.374948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:03.375058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:03.381205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.381650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.382403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.382832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.411469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a3bca21a-7018-4814-b362-1189565dea61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040847 Jul 11 15:56:03.411989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 448/889] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:03.883064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:03.883740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:03.890972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.891647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.892705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:03.893180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:03.960499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:03.968594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b53fef5-0da1-4341-b173-90479c209e83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089836 Jul 11 15:56:03.969181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 442/890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:04.385289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:04.386798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:04.387151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:04.388748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:04.397929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.398676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.399593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.399901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.400471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.400744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.401663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.402357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.433213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-870e9769-fce8-42de-a406-5ce57c20e80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054730 Jul 11 15:56:04.433788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 449/891] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:04.434934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-20db35cb-8e6f-4af3-840b-a53efd2ce88c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054535 Jul 11 15:56:04.435636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 443/892] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:04.438438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:04.439439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:04.445663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.446048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.446821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.447263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.476827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97895e71-e91b-433d-8674-e8d5f52bd055 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Jul 11 15:56:04.477387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 450/893] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:04.987194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:04.988149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:04.994904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.995354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:04.996113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:04.996580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.060217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:05.069565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6886aa52-c469-4cae-b07d-5db307098a8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087031 Jul 11 15:56:05.070176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 444/894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:05.449660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:05.451067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:05.451716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:05.452607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:05.459554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.460015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.460404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.460819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.460959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.461250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.461613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.462041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.490619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-60cd4e51-80b2-46fe-aca4-8ebe5bc56757 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Jul 11 15:56:05.491196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 451/895] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:05.492363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-85cbb2bd-26c1-49db-8688-2f2fc8f91345 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047820 Jul 11 15:56:05.493070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 445/896] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:05.495723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:05.496654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:05.502662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.503105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.503864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:05.504317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:05.533459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-345f4037-575e-4632-8733-6ca585c0721e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041278 Jul 11 15:56:05.533991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 452/897] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:06.091368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:06.092380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:06.100161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.100644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.101404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.101838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.171607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:06.179397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-335efa13-c953-452c-a3ec-3aa8bcbe90cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094677 Jul 11 15:56:06.179935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 446/898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:06.507524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:06.508619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:06.509249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:06.509421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:06.518723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.519173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.519452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.519887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.519996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.520396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.520698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.521130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.550336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-61a997f4-ff54-4aa6-b269-5d80b76319c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049854 Jul 11 15:56:06.550982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 447/899] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:06.552585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cfa2d34b-40fb-4d82-88c0-305f6ccf7c9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052268 Jul 11 15:56:06.553412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 453/900] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:06.555670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:06.556596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:06.562549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.563095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.563836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:06.564266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:06.596642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8cafc527-5424-486f-ae9a-3112dad5cf30 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Jul 11 15:56:06.597165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 448/901] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:07.201193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:07.202232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:07.209694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.210139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.210896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.211328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.280738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:07.288989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e3e7d27-f5a4-4a52-9efb-7cdc8406b9f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095654 Jul 11 15:56:07.289558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 454/902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:07.565796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:07.566508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:07.566929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:07.567439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:07.573703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.574154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.574307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.574677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.574903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.575358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.575529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.575862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.605906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b32eb333-858e-4e61-9749-abb1e62ca5e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046304 Jul 11 15:56:07.606192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df4326aa-e92e-4a25-a380-4afbe8b1a484 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Jul 11 15:56:07.606523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 449/903] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:07.609974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 455/904] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:07.611320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:07.612340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:07.618784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.619233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.619999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:07.620473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:07.650414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff00c249-e371-4640-9f91-629df8f422a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jul 11 15:56:07.650976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 450/905] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:08.310259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:08.311261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:08.318822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.319284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.320052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.320525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.395439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:08.408098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e315b38-92a4-4dab-b3fd-6cd98052057a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.104223 Jul 11 15:56:08.409069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 456/906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:08.620173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:08.621376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:08.621803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:08.623310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:08.630592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.631156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.632110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.632441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.632667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.633006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.633946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.634489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.665382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-333d1aeb-3ec1-403c-b461-15f99d079937 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050311 Jul 11 15:56:08.665965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 451/907] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:08.670533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:08.671442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:08.672236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dce85c8f-b9bc-40fd-8128-213864f28380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056237 Jul 11 15:56:08.672877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 457/908] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:08.677431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.677875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.678622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:08.679050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:08.708343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31a5b10a-c45d-43fc-97ee-e460f4211f5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040963 Jul 11 15:56:08.708843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 452/909] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:09.425040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:09.425663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:09.432620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.433067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.433830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.434268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.496493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:09.504264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-780932d4-bdd9-4517-9207-43eed52b4583 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083298 Jul 11 15:56:09.504868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 458/910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:09.681754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:09.683160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:09.688903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:09.690384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:09.693652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.694104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.694870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.695299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.698446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.698895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.699711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.700141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.725158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d59f5cd-628a-4cf7-a140-28d8486362c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050253 Jul 11 15:56:09.725692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 453/911] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:09.730289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:09.730996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1287dd3e-0590-4a4d-a2de-433d62985443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048699 Jul 11 15:56:09.731150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:09.731614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 459/912] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:09.737194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.737647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.738437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:09.738923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:09.769048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a8a4dbaf-f508-44c4-8244-6d5e231a6e0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jul 11 15:56:09.769604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 454/913] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:10.521591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:10.522110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:10.528783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.529240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.530008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.530452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.602255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:10.610424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-08694b14-a97a-4080-8aa8-ecf5f2e1e679 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092875 Jul 11 15:56:10.611003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 460/914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:10.740874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:10.741839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:10.744929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:10.745842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:10.748256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.748634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.749440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.749876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.752314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.752766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.753548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.753980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.766697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:10.780370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-121e053a-7ece-4ccb-ad96-1b82e013cdb3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Jul 11 15:56:10.780557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 455/915] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:10.784519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0707334-f77c-4850-9059-ebfa2dc44c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043524 Jul 11 15:56:10.785064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:10.785230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 461/916] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:10.785975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:10.792534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.793003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.793772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:10.794210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:10.824869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e020f3c7-769a-4bcc-b39f-b945f6d0e629 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Jul 11 15:56:10.825424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 456/917] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:11.632660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:11.633670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:11.643892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.644692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.645948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.646839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.713566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:11.717051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:11.722001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df5f8f41-c51a-4088-b196-8ae891d93b72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096659 Jul 11 15:56:11.722568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 462/918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:11.795290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:11.796726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:11.799870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:11.801437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:11.807463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.808139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.809357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.810021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.812437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.813144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.814315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.814981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.843955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b668e437-2a49-4308-8221-5c20dfd27007 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054904 Jul 11 15:56:11.844575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 457/919] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:11.848145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-062fcc07-4450-4189-98aa-9217331ced70 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054867 Jul 11 15:56:11.848754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 463/920] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:11.849141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:11.850060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:11.856183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.856663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.857421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:11.857853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:11.886410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ec1572e4-e4bf-4914-a440-d574f725b994 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040759 Jul 11 15:56:11.886890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 458/921] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:12.742621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:12.743228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:12.749675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.750116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.750880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.751297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.819030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:12.830538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-30e4704f-d533-4653-9759-3ccd443e905f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094045 Jul 11 15:56:12.831249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 464/922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:12.856022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:12.856999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:12.860125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:12.861091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:12.864045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.864529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.865300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.865727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.867857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.868312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.869091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.869521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.894709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f2090256-fa68-4ad9-8a92-6c10064d06ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Jul 11 15:56:12.895276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 459/923] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:12.899020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8706ceea-8c74-4a1f-a4bc-ffc00f981c49 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042636 Jul 11 15:56:12.899585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 465/924] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:12.899901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:12.900837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:12.906760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.907204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.907958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:12.908425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:12.937562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44b51c9c-4f74-4bc0-b97b-95529bd379ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Jul 11 15:56:12.938109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 460/925] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:13.854687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:13.855713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:13.867809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.868252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.869263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.869733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.906445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:13.907467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:13.915757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.916749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.917850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.918480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.934435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:13.942233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88298f37-88cd-41f4-806d-17403f77ab25 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094606 Jul 11 15:56:13.943021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 466/926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:13.952204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca2c4343-46e0-4cfb-b479-a832f6ddda9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Jul 11 15:56:13.952816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 461/927] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:13.954264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:13.955182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:13.957086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:13.957289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:13.958582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:13.962992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.963427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.964184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.964552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.964693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.965001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.965783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:13.966218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:13.994026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e3822a1-21a7-4252-abf0-f99f17b86ba9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043703 Jul 11 15:56:13.994241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-036501bd-5dd0-4715-b6e2-2d5c5e2566da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040455 Jul 11 15:56:13.994593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 467/928] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:13.994796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 462/929] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:14.959759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:14.960406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:14.964750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:14.965670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:14.967485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:14.967933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:14.968756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:14.969183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:14.971795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:14.972242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:14.973012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:14.973434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:15.004980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-75d01b26-a624-46b5-8d74-93555310d477 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Jul 11 15:56:15.005567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 463/930] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:15.010834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:15.011752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:15.018368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:15.018931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:15.019709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:15.020137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:15.031366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:15.038948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-509bdca1-38a4-41a9-a710-16fe4152c13c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083524 Jul 11 15:56:15.039587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 468/931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:15.044192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:15.045138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:15.051013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:15.051466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:15.052231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:15.052698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:15.059992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b1e8683-5578-49f6-b10f-42d4ecb96cd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053363 Jul 11 15:56:15.060603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 464/932] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:15.082157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1bf7f44-8f39-48e3-b719-127e48f72ba0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jul 11 15:56:15.083136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 469/933] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:16.018414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:16.019507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:16.027337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.027792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.028593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.029132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.055588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:16.056168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:16.058610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-257deeb3-4343-48ee-9483-a81a75c053a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Jul 11 15:56:16.059312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 465/934] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:16.063412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.063868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.064673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.065105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.128869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:16.137038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b8eff7f-b54f-4cb2-b382-ed6aad9ecbfb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085546 Jul 11 15:56:16.137604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 470/935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:16.142132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:16.143035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:16.149010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.149461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.150224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.150652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.179204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:16.179703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16ce4881-c27c-4391-9d5e-92c34c413b22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Jul 11 15:56:16.180467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 471/936] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:16.180684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:16.187453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.187898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.188705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:16.189138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:16.219854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e1f6f9fd-e13c-4151-9682-2bed92ef696a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152764 Jul 11 15:56:16.220450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 466/937] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:56:17.073109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:17.074091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:17.081587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.082086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.083241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.083716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.114320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3fa4c2ec-227b-42b2-a3ff-f84d4b05d4a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047267 Jul 11 15:56:17.114870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 472/938] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:17.153860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:17.154576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:17.161529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.162007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.162770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.163216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.191124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:17.192042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:17.199174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.199601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.200412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.200823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.231690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:17.232276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37604032-f1b4-41f7-a97e-2dcb3ea56ab2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Jul 11 15:56:17.236242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 473/939] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:17.240115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9be41373-ff84-4e9b-9d4a-0a7a84a784a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090115 Jul 11 15:56:17.240747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 467/940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:17.240918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:17.241933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:17.248602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.249043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.249798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:17.250227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:17.278688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-adb4fa53-89fe-4a3a-b284-531d4dae89ce tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041332 Jul 11 15:56:17.279161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 474/941] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:18.130742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:18.132107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:18.142551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.143291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.144592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.145299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.176409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6b85f465-b1be-4aa9-a23c-655a5ce8f72c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052618 Jul 11 15:56:18.177063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 468/942] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:18.244307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:18.245255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:18.252222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.252699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.253475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.253880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.256820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:18.257429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:18.264157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.264635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.265390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.265816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.283816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8aece871-e798-402a-9173-8bde95440509 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Jul 11 15:56:18.284644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 475/943] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:18.293329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:18.294275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:18.300577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.301042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.301806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:18.302238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:18.328716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:18.332118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f22111ea-2e89-4302-99cc-81141e211279 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042826 Jul 11 15:56:18.333299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 476/944] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:18.337124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29b4ded9-4e58-4f3a-8d3f-a41ad681cf86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084750 Jul 11 15:56:18.337675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 469/945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:19.191571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:19.193086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:19.201185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.201631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.202413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.202838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.238454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b2895d7d-14ae-4963-af36-acb5dcdeaab5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053136 Jul 11 15:56:19.239172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 477/946] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:19.299436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:19.300625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:19.311020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.311700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.312806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.313531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.344793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:19.345732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:19.346527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a3d00dd5-69ad-4aa4-a5c4-738169653a06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053300 Jul 11 15:56:19.347103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 470/947] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:19.353324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:19.353957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.354121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:19.354422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.355293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.355703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.360240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.360736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.361502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:19.361950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:19.387025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-00952301-ae99-408c-a5b8-6497e0c918c5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046386 Jul 11 15:56:19.387813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 478/948] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:19.424650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:19.432724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1f5cdcea-2c8a-4649-8b56-6dbf490017ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083066 Jul 11 15:56:19.433295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 471/949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:20.256848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:20.258320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:20.268852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.269587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.270821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.271530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.289534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:20.303091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8e2cf9c-ba1b-44af-a95e-5e2b36524bb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053061 Jul 11 15:56:20.303668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 479/950] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:20.362356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:20.363908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:20.372733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.373179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.373937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.374369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.378088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:20.398840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:20.399754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:20.405108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba122c3b-7f05-4816-bee9-32b05bd292db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049428 Jul 11 15:56:20.405829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 472/951] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:20.406850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.407294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.408058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.408526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.439265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5adb082-811f-443b-b5f2-50738410bea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044424 Jul 11 15:56:20.439815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 480/952] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:20.449469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:20.450008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:20.456231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.456708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.457460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:20.458233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:20.520008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:20.528408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d2119d56-ec21-4a80-a108-fb6d4748892e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.082882 Jul 11 15:56:20.528979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 473/953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:21.315589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:21.316542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:21.323073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.323524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.324316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.324763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.355003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2749e31-a942-4c63-9077-0dff1cab417e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Jul 11 15:56:21.355558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 481/954] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:21.420904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:21.422350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:21.433779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.434521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.435773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.436561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.452380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:21.453206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:21.460718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.461845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.462618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.463328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.472397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10166df7-b244-4054-9938-8b6de09017b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058050 Jul 11 15:56:21.472960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 474/955] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:21.494307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31b51c2d-54f5-426a-912b-9a939ae369f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 Jul 11 15:56:21.494853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 482/956] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:21.549818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:21.550899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:21.561288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.562023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.563271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:21.563984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:21.633013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:21.641582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e4821df2-edc4-4ec0-93ea-33b420784419 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098226 Jul 11 15:56:21.642181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 475/957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:22.372245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:22.373767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:22.383983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.385225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.386001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.386440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.415409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-672cb9e2-35e3-4bb1-999b-4ecb9da01c38 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050847 Jul 11 15:56:22.416521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 483/958] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:22.488692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:22.490093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:22.498461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.498907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.499670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.500105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.506680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:22.507728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:22.515131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.515587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.516408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.516847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.530603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-94ca3fff-edb1-455f-822b-f94043b19e44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048741 Jul 11 15:56:22.531979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 476/959] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:22.547676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7add745e-39bf-4308-a247-7c521e93eea4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Jul 11 15:56:22.548252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 484/960] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:22.667853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:22.668940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:22.679843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.680660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.682006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:22.682440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:22.752234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:22.761122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8782afc5-440e-44d6-ad82-3119707ddcba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099697 Jul 11 15:56:22.761691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 477/961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:23.432457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:23.433480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:23.440611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.441107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.441945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.442427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.473954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-152a82b2-5e13-46d6-abd3-95df71fb83d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048593 Jul 11 15:56:23.474422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 485/962] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:23.546867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:23.548375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:23.558584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.559024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.559777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.560203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.560856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:23.561777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:23.568605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.569061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.569828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.570268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.590867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a85ed719-ac88-4c1a-a438-ec991c43399e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051211 Jul 11 15:56:23.591440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 478/963] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:23.601076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-116ee8db-1b79-4ddf-92d0-35cf9a4d81f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Jul 11 15:56:23.601636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 486/964] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:23.779116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:23.779627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:23.786108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.786554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.787303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:23.787729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:23.850807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:23.858712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-16aa85ad-be6c-4a9e-a599-43822c654814 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083688 Jul 11 15:56:23.859276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 479/965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:24.489627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:24.491028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:24.501458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.502195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.503443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.504159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.536075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-84ff6a26-271e-4090-82f9-8e7720dff6f9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053239 Jul 11 15:56:24.536667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 487/966] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:24.606562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:24.607632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:24.612679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:24.613605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:24.614889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.615338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.616104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.616577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.620367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.620866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.621700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.622210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.648172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d14e5f9b-cf81-431c-94c3-3f2fb8e3ea76 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047806 Jul 11 15:56:24.648813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 480/967] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:24.651310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8870e07-ace4-421f-b1bf-91cb09e6fd71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042614 Jul 11 15:56:24.651877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 488/968] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:24.876709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:24.877311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:24.883829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.884281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.885061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:24.885496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:24.948681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:24.959426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7ef739d3-a424-48a1-9e28-c7ed0a0f4fd4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086367 Jul 11 15:56:24.960098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 481/969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:25.552023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:25.553599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:25.561963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.562413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.563172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.563606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.594772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2046d3b0-829f-459e-9894-5fade57770b1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049412 Jul 11 15:56:25.595325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 489/970] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:25.664327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:25.665811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:25.667127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:25.668665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:25.677082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.677832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.679093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.679412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.679828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.680258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.681503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.682200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.712174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62a23d67-82bd-4ad9-8edf-2ebfd9356e0c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054450 Jul 11 15:56:25.712569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-12c10d0c-9f19-40eb-9883-4620b23b4763 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052048 Jul 11 15:56:25.712820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 482/971] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:25.713125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 490/972] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:25.982284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:25.983038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:25.990896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.991455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:25.992413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:25.992947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.069446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:26.077594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15e5c214-a378-480a-93fe-0ae7463d75c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101932 Jul 11 15:56:26.078165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 483/973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:26.608510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:26.609515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:26.616636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.617128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.617969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.618431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.650612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7506c55-29e3-422c-85c1-667e886979e6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047448 Jul 11 15:56:26.651179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 491/974] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:26.729020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:26.729910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:26.730555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:26.731483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:26.737692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.738125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.738342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.738764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.738893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.739287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.739529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:26.739961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:26.770626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-389a1060-2cad-42ba-b828-381ef8fefa09 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048316 Jul 11 15:56:26.771168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 484/975] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:26.771537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80f8bb5a-8f24-4715-b820-15458c09b8d0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048367 Jul 11 15:56:26.772242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 492/976] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:27.097629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:27.098385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:27.106873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.107431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.108417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.108962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.174214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:27.182168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4da59b19-9f3d-4ea2-82c3-b6f84d11f107 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089468 Jul 11 15:56:27.182708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 485/977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:27.667352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:27.669144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:27.679284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.680029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.681349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.682081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.712682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73e8dda0-4376-4498-986c-2095de8d5a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052056 Jul 11 15:56:27.713241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 493/978] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:27.786163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:27.787007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:27.787840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:27.788405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:27.798814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.799556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.800069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.800848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.801126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.801562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.802083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:27.802795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:27.835190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d369b7fd-9759-4670-b622-4063d5518c13 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055792 Jul 11 15:56:27.835741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 486/979] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:27.835901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-caf172b6-7d07-4175-9b9b-8a5c5ddc9ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055804 Jul 11 15:56:27.836412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 494/980] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:28.201914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:28.202522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:28.209310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.209754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.210503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.210932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.275636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:28.289452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d19e957-0f1b-4d3d-864c-3219fcf19267 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092283 Jul 11 15:56:28.290248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 487/981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:28.728936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:28.732101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:28.742254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.742998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.744322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.745029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.775806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b9c478a6-0ed4-43a8-ae07-021b9b6325d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053536 Jul 11 15:56:28.776417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 495/982] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:28.851507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:28.852587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:28.853219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:28.853373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:28.861156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.861350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.861603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.861751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.862367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.862504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:28.862797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.862947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:28.866673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:28.889382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:28.893577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-605fbf59-2af9-4eb4-8d5a-2d04d7001dbd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048676 Jul 11 15:56:28.894149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 496/983] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:28.894531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24e79ea4-0859-4992-a94e-4010bd8b75e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049944 Jul 11 15:56:28.895098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 488/984] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:29.311508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:29.312352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:29.320635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.321235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.322227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.322803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.389059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:29.397073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df0cb9e0-f96b-4837-90da-4373da25e1ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091756 Jul 11 15:56:29.397629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 497/985] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:29.789372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:29.790622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:29.798213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.798658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.799404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.799830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.829746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cec461d5-bbc0-4937-b9fe-0f5b68031bc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Jul 11 15:56:29.830300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 489/986] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:29.906653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:29.907236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:29.907719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:29.908181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:29.910524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:29.914926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.915376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.916121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.916696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.916820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.917122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.917889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:29.918325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:29.946821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-213215ca-10bf-48bf-ab1b-707cfe9e4c91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jul 11 15:56:29.947362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 498/987] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:29.947496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5a7648cb-2d68-495e-b11b-954fcb68c9d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044083 Jul 11 15:56:29.948128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 490/988] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:30.418738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:30.419747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:30.426348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.426803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.427568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.428009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.492682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:30.500493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f4ec95d2-bfaf-4cee-9034-c3a8f6fdd10c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088242 Jul 11 15:56:30.501056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 499/989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:30.842878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:30.843831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:30.850487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.850965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.851726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.852166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.882503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-23351f69-b207-401c-b800-3b14f4f1eaf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Jul 11 15:56:30.883051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 491/990] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:30.963843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:30.964965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:30.965594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:30.965768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:30.976216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.977008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.977268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.978039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.978426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.978943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:30.979379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:30.980110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:31.010504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56831ac0-5f2a-4f04-b12d-0152b9a421c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053436 Jul 11 15:56:31.011062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 492/991] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:56:31.012032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1c474912-c21c-475e-87bf-304127f81352 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055065 Jul 11 15:56:31.012640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 500/992] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:31.521555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:31.522434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:31.532432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:31.532878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:31.533670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:31.534107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:31.611339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:31.622763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-730e645c-658f-4bf2-b1ea-81ed22882a3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.108533 Jul 11 15:56:31.623404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 493/993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:31.896274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:31.897230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:31.903808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:31.904253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:31.905172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:31.905603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:31.935506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6eeccb1d-61ee-4dcf-996b-fcb5239f8765 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Jul 11 15:56:31.936043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 501/994] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:32.026545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:32.028068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:32.028720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:32.030196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:32.036814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.037260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.037632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.038007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.038116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.038432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.038819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.039247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.070260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-03feff7b-b257-4f74-8b35-96fdf355491d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050298 Jul 11 15:56:32.070857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 494/995] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:32.231741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf5cf03c-d24d-4cfb-ac81-2dddf7320494 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209515 Jul 11 15:56:32.232319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 502/996] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:32.644437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:32.645041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:32.651306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.651776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.652534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.652979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.715378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:32.723243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1ebdf69-d1b2-42a9-867e-fc489dcbf607 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085128 Jul 11 15:56:32.723814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 495/997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:32.953155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:32.954538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:32.965151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.965816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.966981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:32.967576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:32.998066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-71a4ea21-62e1-4fb2-b430-f2f5027c79b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051417 Jul 11 15:56:32.998611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 503/998] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:33.086882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:33.088560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:33.097679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.098206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.098991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.099444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.128871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c66ab914-37fc-419b-a369-f0b433e4e62c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049754 Jul 11 15:56:33.129447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 496/999] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:33.244897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:33.245751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:33.252582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.253202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.254309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.254754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.285696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ec1aa143-b3e5-4f5f-baef-65de22017086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Jul 11 15:56:33.286245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 504/1000] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:33.744550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:33.745584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:33.755455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.755929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.756706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:33.757135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:33.819856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:33.827919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7b9ba037-75a2-4513-938e-9f6a209a3928 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090951 Jul 11 15:56:33.828763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 497/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:34.010496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:34.011396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:34.018337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.018793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.019557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.019996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.048952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-173a92a3-59c8-4023-86d6-f26c3545b6ac tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Jul 11 15:56:34.049508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 505/1002] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:34.143329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:34.144630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:34.151710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.152165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.152959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.153395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.182701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d40e41c5-2dd3-4940-b226-213c4b80835c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044855 Jul 11 15:56:34.183272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 498/1003] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:34.301808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:34.303612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:34.314115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.314876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.316328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.317114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.349753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d0feded-291a-46fb-8cbe-93680017c824 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054732 Jul 11 15:56:34.350302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 506/1004] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:34.845777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:34.846458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:34.854056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.854548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.855481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:34.855917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:34.926894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:34.938716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b0bace10-82f3-4a82-87a7-c3e135a6d0ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097201 Jul 11 15:56:34.939540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 499/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:35.065313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:35.066789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:35.073919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.074366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.075119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.075549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.105062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c23f405-99f5-4e1b-8cb7-a50984ea266f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 Jul 11 15:56:35.105519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 507/1006] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:35.197208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:35.198124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:35.204588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.205029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.205778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.206207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.235560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f60bad7e-5314-4c99-a37f-d9f2f40292a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043494 Jul 11 15:56:35.236123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 500/1007] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:35.365987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:35.366831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:35.373503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.373959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.374725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.375165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.413346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-95d55ea1-de71-453e-bdb1-81571f6d0234 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053552 Jul 11 15:56:35.414074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 508/1008] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:35.961307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:35.962269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:35.972590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.973433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:35.974735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:35.975173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.047306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:36.056203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-764d765e-de0b-42f8-bc09-3d3bea752ded tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102155 Jul 11 15:56:36.056830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 501/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:36.119647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:36.120726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:36.128742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.129181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.130040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.130546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.161633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-acf21261-5904-4523-a864-d05147f369c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047249 Jul 11 15:56:36.162219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 509/1010] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:36.252183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:36.253722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:36.264702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.265455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.266726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.267443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.299637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4cac6f91-fdd3-43c0-bb2a-4a27fb42cd38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054220 Jul 11 15:56:36.300181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 502/1011] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:36.431586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:36.433016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:36.443201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.444018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.444832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:36.445273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:36.475880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-85a6c6b6-0209-4632-946a-e79fdfa73f4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051360 Jul 11 15:56:36.476483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 510/1012] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:37.076971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:37.077830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:37.087504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.088094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.088898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.089339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.151930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:37.159608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87015251-784d-4e0a-808e-5cb5d4df1591 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089057 Jul 11 15:56:37.160175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 503/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:37.173075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:37.173998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:37.180752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.181198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.181950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.182375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.211904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6dea20a9-5d3d-4287-a533-83cddb4918d3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Jul 11 15:56:37.212480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 511/1014] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:37.316002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:37.317541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:37.325151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.325576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.326341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.326771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.358537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eae28ae4-28bf-4ae7-bf0a-a5211e5c356e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048941 Jul 11 15:56:37.359039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 504/1015] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:37.491538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:37.493062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:37.503108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.503842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.505170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:37.506027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:37.531075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:37.535958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ae1014d-673f-4c7f-8c69-b4b75703d836 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051273 Jul 11 15:56:37.536557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 512/1016] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:38.181630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:38.182511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:38.192933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.193689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.194784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.194891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.213722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:38.223310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:38.224234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:38.231558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.232006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.232798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.233229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.259027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:38.263268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6144e9bb-ebf6-43ec-866a-bcead584378b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Jul 11 15:56:38.263845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 513/1017] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:38.266737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9f2ff65d-0a0f-4198-9137-0654ba4a6806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091859 Jul 11 15:56:38.267288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 505/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:38.372100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:38.373071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:38.379780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.380230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.381181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.381967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.411742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4a9cdfa1-1629-4865-954a-7cbb311ea903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043742 Jul 11 15:56:38.412714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 514/1019] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:38.551541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:38.553580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:38.560496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.560944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.561704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:38.562140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:38.592840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96e2b76b-8b84-40b7-8fa6-a30015b282ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Jul 11 15:56:38.593402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 506/1020] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:39.278274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:39.279488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:39.284768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:39.285577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:39.289143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.289450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.290477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.291060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.293840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.294595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.295632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.296212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.325021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d19d35f8-cfb1-48f4-a2ce-11fc560f4736 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052450 Jul 11 15:56:39.325580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 515/1021] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:39.365787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:39.377182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c1c0013-a752-454a-a6da-fa411ae3168a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097150 Jul 11 15:56:39.377974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 507/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:39.425547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:39.426457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:39.433039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.433507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.434261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.434718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.464428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-877430cc-9a83-4457-93f4-083aba0a4126 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042787 Jul 11 15:56:39.464921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 516/1023] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:39.609084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:39.610538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:39.622855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.623728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.625424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:39.626418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:39.820562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff681777-e847-41a4-80f4-5593dcff2ef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219376 Jul 11 15:56:39.821123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 508/1024] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:40.341672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:40.343165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:40.346784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:40.354148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.354591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.355391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.355830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.386561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c664f7ad-6245-4cd6-aa95-939cedf97f2b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052034 Jul 11 15:56:40.387113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 517/1025] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:40.395055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:40.395666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:40.402763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.403387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.404538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.404975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.468505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:40.475322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:40.476369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:40.476563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b92f3dd3-1da0-4572-b6c3-b65d6c9e5a85 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085248 Jul 11 15:56:40.477110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 509/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:40.482879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.483334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.484099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.484560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.514319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ad9cc83b-bd1b-46be-babc-9b38d775c353 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043090 Jul 11 15:56:40.514874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 518/1027] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:40.834713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:40.836333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:40.843493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.843906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.844667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:40.845095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:40.876832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f082c7c9-71c4-482e-9bb6-effde37e2227 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Jul 11 15:56:40.877391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 510/1028] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:41.403478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:41.404988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:41.416245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.417029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.418274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.418988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.452466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c0657fb-ba61-4dd9-9d43-112b2eea2c1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056208 Jul 11 15:56:41.452949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 519/1029] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:41.494073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:41.494681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:41.501100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.501548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.502298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.502732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.526635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:41.527580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:41.533950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.534391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.535149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.535580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.565461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:41.567204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a20163d2-f761-4a32-961c-ee98b597fea7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Jul 11 15:56:41.567963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 520/1030] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:41.573523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5161e5f8-35be-46a2-8022-dd8c6bc5b957 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083889 Jul 11 15:56:41.574079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 511/1031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:41.892354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:41.893851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:41.904686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.905478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.906730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:41.907465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:41.939607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cb936d74-cdc0-4822-b403-dcdfac5a13c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053906 Jul 11 15:56:41.940155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 521/1032] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:42.468998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:42.470343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:42.479695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.480142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.480925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.481380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.509488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50541eb5-0ab8-44df-9a08-f8d982745375 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Jul 11 15:56:42.510032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 512/1033] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:42.584076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:42.585575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:42.595826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:42.596870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:42.597275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.598012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.599254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.599967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.606120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.606570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.607332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.607759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.630741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b19f4ae-a7f2-4167-8a69-e35ea3aea50e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053978 Jul 11 15:56:42.631290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 522/1034] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:42.670462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:42.678074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-608daa65-b5ff-41e7-b279-2763c25a77bd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088657 Jul 11 15:56:42.678625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 513/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:42.955606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:42.957143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:42.965372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.965823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.966589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:42.967029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:42.997201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-417d588f-6e8d-4f49-bc20-14ffea41c80d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Jul 11 15:56:42.997751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 523/1036] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:43.525107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:43.526269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:43.535306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.535862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.536934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.537471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.569938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66ba2b2a-da23-43c7-b314-e7cabb2e4953 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051252 Jul 11 15:56:43.570501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 514/1037] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:43.647267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:43.649155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:43.656001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.656483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.657238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.657675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.686982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40ef015f-db68-4e44-b8a2-3dc391bc4ab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046662 Jul 11 15:56:43.687541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 524/1038] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:43.699471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:43.700079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:43.708716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.709370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.711146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:43.711588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:43.778416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:43.786276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c18e2490-aaea-4925-8072-321d32ba449e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093153 Jul 11 15:56:43.786837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 515/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:44.009395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:44.010321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:44.016708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.017204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.017957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.018411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.049396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b68c77b6-4182-49a1-a02c-4cdeb1445ae0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Jul 11 15:56:44.050299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 525/1040] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:44.586865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:44.588347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:44.599310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.600059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.601438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.602055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.634119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e67cca24-00f1-456c-9b5f-3c296941efec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054359 Jul 11 15:56:44.634675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 516/1041] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:44.700099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:44.701126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:44.708802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.709281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.710112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.710574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.741550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-041af1cc-6cbe-41b6-9ef9-d7734f5bc988 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 Jul 11 15:56:44.742098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 526/1042] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:44.806868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:44.807854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:44.818052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.818783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.820019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:44.820801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:44.885369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:44.895693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-615f52ca-d50b-4478-8128-b182822db03b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095636 Jul 11 15:56:44.896304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 517/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:45.061798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:45.062717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:45.069209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.069683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.070544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.071010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.103497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d36efd52-f2a3-497d-ab00-6711e77cc56e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Jul 11 15:56:45.104067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 527/1044] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:45.646180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:45.647142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:45.654101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.655126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.655384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.655818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.690947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-483fb0af-0d83-4fbf-a9fa-b78313da5f25 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Jul 11 15:56:45.691425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 518/1045] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:45.756458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:45.757631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:45.766646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.767236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.768234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:45.768857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:45.799250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-176064d7-2e1a-4f65-ad31-bdcd1e3454e0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048776 Jul 11 15:56:45.799793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 528/1046] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:46.019444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:46.020063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:46.026472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.026911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.027662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.028086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.092531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:46.100205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21f1928f-e0f1-4319-b966-c18b21782bc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.190957 Jul 11 15:56:46.100805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 519/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:46.115220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:46.116152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:46.122916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.123394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.124160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.124658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.141561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:46.154819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a7e0c141-5213-41e7-a71c-05cdbc5156ba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Jul 11 15:56:46.155374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 529/1048] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:46.707387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:46.709295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:46.716931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.717378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.718131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.718561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.748587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44a084fc-d392-423b-9c52-ee4360e7eb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Jul 11 15:56:46.749138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 520/1049] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:46.816329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:46.817827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:46.825664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.826116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.826883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:46.827323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:46.858004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-86b1bc14-a490-442d-ab74-5053954a3d41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048434 Jul 11 15:56:46.858554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 530/1050] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:47.120932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:47.121918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:47.132125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.133023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.134065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.134475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.166640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:47.167544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:47.173960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.174405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.175169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.175599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.197241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:47.205144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d99f1b97-4211-455b-95bc-e65a0b136843 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090915 Jul 11 15:56:47.205725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 521/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:47.205874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5255e56a-a5d9-4843-8151-b83cc8b147b0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Jul 11 15:56:47.206422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 531/1052] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:47.761832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:47.762926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:47.770912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.771448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.772350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.772908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.777386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:47.805003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba5472b7-e8ef-4c03-9aae-e0cc713accdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048012 Jul 11 15:56:47.805553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 522/1053] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:47.874270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:47.875751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:47.885944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.886065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.886762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:47.887220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:47.917106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ff8b63a1-8caa-42cf-a513-0457fde66fc5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049995 Jul 11 15:56:47.917670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 532/1054] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:48.218123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:48.219076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:48.222368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:48.222970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:48.225504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.225950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.226713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.227165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.229086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.229532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.230276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.230709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.256529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30ea58f9-8c88-474b-87dd-32b62dabd432 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Jul 11 15:56:48.257118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 523/1055] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:48.296092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:48.303636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7de6f3a8-07d6-4227-b3c1-deec4b80f5f5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085093 Jul 11 15:56:48.304195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 533/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:48.816307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:48.817248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:48.824156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.824628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.825395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.825851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.856206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31dd74da-4dc1-44ca-b419-de9c0447cb09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Jul 11 15:56:48.856807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 524/1057] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:48.932176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:48.933116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:48.940215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.940696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.941448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:48.941875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:48.972048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e9fef8df-394e-465c-9e76-ac92a3704db0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045378 Jul 11 15:56:48.972622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 534/1058] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:49.271986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:49.272943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:49.280502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.280936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.281758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.282205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.321359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:49.321993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:49.328323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f45369ff-7fdd-4b7e-8f7e-f751c463365b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061396 Jul 11 15:56:49.328626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.329074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.329385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 525/1059] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:49.329919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.330440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.644997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:49.653824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-78e2179c-e172-48ec-9310-be23d1e198cc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.336578 Jul 11 15:56:49.654375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 535/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:49.871094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:49.872018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:49.879255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.879700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.880510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.880939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.912374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f9f00fe-6f1f-492b-901a-5749e569bc60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046771 Jul 11 15:56:49.912840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 526/1061] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:49.985800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:49.986943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:49.996096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.996822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:49.997969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:49.998658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.033057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-84a6f15a-f85d-4993-9102-c427673c664e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051348 Jul 11 15:56:50.033721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 536/1062] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:50.341957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:50.342872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:50.349597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.350045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.350792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.351196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.383032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-38cbb382-7b78-4efa-9aff-55e4ab98dfc7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Jul 11 15:56:50.383572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 527/1063] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:50.681748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:50.682789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:50.693470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.694173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.695483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.695916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.767268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:50.775334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b45ee7c-6007-4d80-ac55-25c24208cd6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100219 Jul 11 15:56:50.775898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 537/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:50.927626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:50.928986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:50.938846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.939614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.940930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:50.941694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:50.972251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9061939d-143b-4811-be9c-7323479ced17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051158 Jul 11 15:56:50.972826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 528/1065] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:51.045404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:51.046345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:51.053064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.053507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.054259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.054769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.084088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3ac7ef31-031c-4661-a75c-c5801f5102ee tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042648 Jul 11 15:56:51.084577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 538/1066] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:51.398853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:51.400360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:51.410420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.411171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.412548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.413268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.442545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-754ee2ab-0eef-401f-aa6a-18e9b770150c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050315 Jul 11 15:56:51.443008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 529/1067] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:51.793245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:51.793858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:51.800509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.800967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.801725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.802162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.866122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:51.874562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49ec34cd-6d03-47b2-b706-1bf6165cba87 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085664 Jul 11 15:56:51.875148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 539/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:51.987366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:51.988695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:51.996910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.997355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:51.998108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:51.998501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.027967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf28e514-f5c3-41b9-a2d3-0cfb7b638d56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Jul 11 15:56:52.028536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 530/1069] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:52.101040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:52.102594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:52.109503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.109951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.110697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.111127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.140375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f58dc20d-0c0a-4880-859b-126ef2e04ccd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046490 Jul 11 15:56:52.140918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 540/1070] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:52.461609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:52.462552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:52.470630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.471253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.472357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.472968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.511575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-378e7af6-e18d-4f26-a7c7-ed95587e9884 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059679 Jul 11 15:56:52.512151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 531/1071] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:52.896161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:52.897229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:52.908172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.908983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.910300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:52.911025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:52.978453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:52.987287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-01a47cf6-ac9a-481e-ba6e-e7d1e2ca3182 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097760 Jul 11 15:56:52.987855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 541/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:53.039510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:53.040528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:53.047346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.047793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.048588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.049021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.084144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9dff50d9-8202-4965-a92e-9f375bcb8766 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048552 Jul 11 15:56:53.085024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 532/1073] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:53.156852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:53.158816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:53.167764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.168221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.168994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.169422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.200245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-22f33148-50d4-404e-ac06-ebf39c54bba0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050270 Jul 11 15:56:53.200841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 542/1074] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:56:53.527066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:53.528128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:53.536230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.536844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.537822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:53.538365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:53.572847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96634f47-03fe-476a-a988-953c9a4063da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051847 Jul 11 15:56:53.573412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 533/1075] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:54.004739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:54.005369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:54.012004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.012515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.013283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.013722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.079195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:54.087591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4feb160a-1449-4f95-9182-7ea261676546 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086953 Jul 11 15:56:54.088233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 543/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:54.096647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:54.097577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:54.104906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.105352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.106112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.106550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.135140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-de3620b3-925e-4284-934f-c439b888dac9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jul 11 15:56:54.136184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 534/1077] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:54.215270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:54.216250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:54.223218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.223675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.224478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.224919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.255462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63221d89-4b4f-4acf-b38d-e89d1c7a634d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045706 Jul 11 15:56:54.256008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 544/1078] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:54.588147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:54.589727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:54.599899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.600712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.601956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:54.602639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:54.632875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6588dde1-0008-4061-a0be-3584bdd52dd4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051704 Jul 11 15:56:54.633423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 535/1079] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:55.107536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:55.108209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:55.115382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.115880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.116749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.117256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.147211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:55.148127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:55.155128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.155596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.156342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.156786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.180954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:55.186857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3f80d3a1-d6b4-4e08-864a-4111f55ed08e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Jul 11 15:56:55.187935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 536/1080] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:55.190387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d166894-b02b-4430-be21-f046ea309385 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088150 Jul 11 15:56:55.191105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 545/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:55.271295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:55.272795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:55.283534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.284271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.285608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.286318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.318981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77f4610a-3be3-4c98-8fd5-d66867511ae4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054209 Jul 11 15:56:55.319534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 537/1082] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:55.645642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:55.646594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:55.653619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.654048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.654806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:55.655235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:55.658921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:55.684825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef90ef7b-77b8-46dc-a31c-a965173b80e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 11 15:56:55.685367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 546/1083] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:56.203992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:56.205529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:56.211188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:56.212335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:56.215929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.216391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.217144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.217554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.219422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.219974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.220818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.221254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.242176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:56.247392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9709bc9-7df3-4c28-a20a-ba8cf4698da2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051439 Jul 11 15:56:56.247950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 538/1084] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:56.282207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:56.290046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3769526d-c6c7-4c8c-a71d-4be692821966 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085860 Jul 11 15:56:56.290600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 547/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:56.331337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:56.332276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:56.339152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.339585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.340387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.340820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.375911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55e5964d-40fb-4f2b-ba8f-96a0a389cc1d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048760 Jul 11 15:56:56.376474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 539/1086] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:56.700098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:56.701072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:56.708271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.708749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.709520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:56.709951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:56.740710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e3d54cce-4542-4cb6-89e0-120c15877aa6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Jul 11 15:56:56.741263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 548/1087] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:57.262297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:57.263219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:57.265537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:57.271298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.271736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.272510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.272939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.303214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-40b7a082-76fa-4c68-b589-69b5117abf8a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Jul 11 15:56:57.303764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 540/1088] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:57.306622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:57.307239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:57.313529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.313986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.314746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.315185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.375536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:57.383379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-baed9da9-3f0b-4e36-b3f7-20beb64446ae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.080696 Jul 11 15:56:57.383944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 549/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:57.387315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:57.388220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:57.394460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.394899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.395641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.396065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.424725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4dead95-980a-4170-b907-a34a9d883010 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041466 Jul 11 15:56:57.425257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 541/1090] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:56:57.756721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:57.758211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:57.769307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.770134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.771503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:57.772234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:57.803577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-47d1a84f-f150-4b63-b7d5-8d84b11dd58a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053709 Jul 11 15:56:57.804143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 550/1091] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:58.319535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:58.321148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:58.329354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.329783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.330548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.330984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.360246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45e864e8-ae57-445a-b359-8b2a600b5367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Jul 11 15:56:58.360827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 542/1092] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:58.402185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:58.402798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:58.409686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.410130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.410901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.411330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.437333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:58.438258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:58.444731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.445100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.445857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.446282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.480926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:58.482551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3f5a703-9abe-45f8-be95-2f5b79a526ac tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050154 Jul 11 15:56:58.483129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 543/1093] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:58.488742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f828b6c-9dd2-4dd1-bbfe-1587c376f984 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092073 Jul 11 15:56:58.489294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 551/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:58.816274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:58.817222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:58.824461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.824903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.825690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:58.826118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:58.856264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd792d83-e45a-482e-84bd-cec2ed99aa88 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Jul 11 15:56:58.856863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 544/1095] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:59.376215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:59.377742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:59.388981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.389714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.390959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.391673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.425507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c2eb5ab2-1bdc-4f90-a4cb-445c8200c45f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056173 Jul 11 15:56:59.426073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 552/1096] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:56:59.494463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:59.495424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:59.502273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.502715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.503461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.503861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.505692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:59.506432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:59.512794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.513269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.513981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.514416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.533722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5050a56-f91b-499f-ae94-c13765e81573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043396 Jul 11 15:56:59.534279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 545/1097] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:56:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:56:59.575001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:56:59.583240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-902e8124-b27d-422b-9c7c-a3ffdf8dd03f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.081204 Jul 11 15:56:59.583801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 553/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:56:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:56:59.871249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:56:59.872192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:56:59.880445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.881192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.882281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:56:59.883088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:56:59.918814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1eee845-06ed-479e-9d85-660dcc544afa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054025 Jul 11 15:56:59.919334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 546/1099] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:56:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:00.441611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:00.443151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:00.454411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.455117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.456380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.457150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.489836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16e3fd7e-fa5d-4ed0-8eef-29e755f1c44d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055031 Jul 11 15:57:00.490385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 554/1100] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:00.550570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:00.552031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:00.561144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.561588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.562337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.562761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.592683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bae801d0-4f57-46d1-af7f-f4e913df98c7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048742 Jul 11 15:57:00.593234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 547/1101] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:00.600084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:00.600734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:00.607128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.607615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.608412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.608844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.675101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:00.687414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-340d50b0-ea25-4562-a751-3540fec89dc4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090878 Jul 11 15:57:00.688460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 555/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:00.934257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:00.935777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:00.945788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.946521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.947974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:00.948553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:00.978033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d0045545-9eb4-4041-8378-2945d012feaa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050499 Jul 11 15:57:00.978568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 548/1103] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:01.506276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:01.507655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:01.515504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.515941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.516740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.517178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.547042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e479ee82-23b9-477c-9a4a-84ff5b247987 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047981 Jul 11 15:57:01.547591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 556/1104] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:01.604678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:01.605596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:01.612740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.613187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.613935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.614341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.643596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e58bd067-af97-49e1-a032-d8638106b4e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043048 Jul 11 15:57:01.644129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 549/1105] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:01.709677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:01.710286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:01.716773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.717245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.717993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:01.718566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:01.780090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:01.788308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-169b8bdb-89b1-4462-bdad-ccd0484b5aa8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.082896 Jul 11 15:57:01.788894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 557/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:01.995237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:01.996244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:02.003322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.003843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.004729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.005205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.036438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cc845dbd-8fab-474c-91ed-db4f1a3f8796 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047838 Jul 11 15:57:02.036912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 550/1107] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:02.559508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:02.560502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:02.567211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.567684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.568477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.569021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.599417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11244358-0767-4838-9ba2-0e25b7c2d770 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Jul 11 15:57:02.599974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 558/1108] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:02.656779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:02.657768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:02.665984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.666648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.667657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.667912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.700625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3f98de02-2b22-4124-8ba5-0e4ad0db26cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048897 Jul 11 15:57:02.701169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 551/1109] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:02.804746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:02.805361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:02.812213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.812635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.813405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:02.813862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:02.885980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:02.893722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d46710ed-6804-4358-872f-20301320876a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092993 Jul 11 15:57:02.894290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 559/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:03.052370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:03.053867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:03.064189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.064891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.066144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.066858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.099251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8007daff-37b9-46b1-a3ce-83f9f12ca8c6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053503 Jul 11 15:57:03.099810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 552/1111] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:03.617222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:03.618743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:03.626814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.627296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.628101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.628584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.660038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-349be4a7-d15f-4130-84b4-0d3a001623a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 Jul 11 15:57:03.660623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 560/1112] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:03.716916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:03.718381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:03.729400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.729795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.730575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.731009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.759706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d91e587-a890-4b4e-8f0b-21a95b5ba571 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049888 Jul 11 15:57:03.760445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 553/1113] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:03.915833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:03.916975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:03.923523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.923974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.924771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:03.925202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:03.989895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:03.997610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8093fe44-2d0a-4bf6-a2c5-5802a817e93e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089076 Jul 11 15:57:03.998168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 561/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:04.110972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:04.111889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:04.118056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.118509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.119265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.119756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.148763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c65ffb1e-7b92-45d0-9642-a5b0b120b7bf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Jul 11 15:57:04.149234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 554/1115] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:04.676414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:04.677905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:04.690324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.691086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.692358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.693122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.728542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:04.734780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9fc7fff2-704b-4f59-95e0-0ae87c235c7a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065128 Jul 11 15:57:04.735344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 562/1116] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:04.774959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:04.776162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:04.785935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.786496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.787607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:04.788198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:04.805830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:04.819130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-73eed2d6-6dbb-41e7-93b2-04a7a7084d87 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050686 Jul 11 15:57:04.819681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 555/1117] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:05.019819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:05.020740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:05.029387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.029841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.030610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.031031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.100264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:05.110336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1bb9c192-cdaa-45f8-b3bd-8da1c2fca097 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097590 Jul 11 15:57:05.111136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 563/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:05.162594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:05.163804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:05.171514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.171963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.172744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.173175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.203329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b2eca210-aa98-46c6-a71b-5e2ba5357b70 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Jul 11 15:57:05.203893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 556/1119] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:05.751141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:05.752727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:05.763650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.764441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.765700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.766421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.799007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-490a767b-41f6-42ba-a75a-40750c2ff851 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054720 Jul 11 15:57:05.799553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 564/1120] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:05.834181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:05.835400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:05.843010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.843483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.844231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:05.844687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:05.873643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9876d65c-f2e5-463a-920f-a8934c5602f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046184 Jul 11 15:57:05.874192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 557/1121] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:06.134843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:06.135854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:06.143813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.144413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.145370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.145917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.215354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:06.217656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:06.218691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:06.223233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c0c888db-6a39-4e4f-bf0f-1a604c924913 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094968 Jul 11 15:57:06.224035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 565/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:06.225227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.225755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.226581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.227086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.257053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-323e7f3b-0040-4c35-b210-fe6c664b9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Jul 11 15:57:06.257598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 558/1123] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:06.815047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:06.816541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:06.825529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.825979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.826730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.827162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.856861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a067e126-6cbd-4cdc-8e59-a03a6419bd86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 Jul 11 15:57:06.857397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 566/1124] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:06.886628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:06.887552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:06.894665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.895115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.895901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:06.896405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:06.926963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c265ed3-eb59-4873-ba93-cac92a8bf573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044457 Jul 11 15:57:06.927509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 559/1125] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:07.240678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:07.241297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:07.243149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:07.248742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.249189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.249965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.250400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.268195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:07.269182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:07.275446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.275967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.276780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.277207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.307161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-da9e852f-5477-46ed-8297-1f5193b65acf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Jul 11 15:57:07.308103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 560/1126] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:07.318391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:07.330411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9ef5269-6c2b-46b6-aba9-50675a050614 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093516 Jul 11 15:57:07.331166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 567/1127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:07.872049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:07.873449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:07.881214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.881761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.882690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.883434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.916043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5943a62f-0082-4529-8042-162d94660024 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050006 Jul 11 15:57:07.917274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 561/1128] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:07.939078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:07.939979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:07.946667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.947116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.947921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:07.948379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:07.985989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5a024e07-af99-4d97-8e45-a6eb873e2b6a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050883 Jul 11 15:57:07.986575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 568/1129] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:08.323397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:08.324471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:08.331474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.331972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.333175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.333661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.350731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:08.351406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:08.358258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.358670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.359458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.359890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.365323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c077abee-eca1-4fde-b1c5-4027dcd24344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048525 Jul 11 15:57:08.365887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 562/1130] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:08.421120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:08.428980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ba3861b-9528-4eb1-a61e-e4a31e6bfca1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.082571 Jul 11 15:57:08.429510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 569/1131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:08.933450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:08.934946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:08.945931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.946684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.947927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:08.948501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:08.978151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8dc9c8a2-961b-429e-a18a-884a15ad6ef2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Jul 11 15:57:08.978877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 563/1132] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:08.997905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:08.998823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:09.005685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.006134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.006890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.007321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.036547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5508179d-404d-4c7d-933d-782a8c3766b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042821 Jul 11 15:57:09.037122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 570/1133] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:09.380621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:09.382177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:09.392645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.393406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.394660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.395385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.426543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8549fd98-2970-4ffa-b73d-81cab9cfc473 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052620 Jul 11 15:57:09.427102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 564/1134] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:09.450400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:09.450936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:09.457086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.457857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.458604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:09.459038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:09.519879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:09.527794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18ed4436-46d0-4c8d-8c6c-f2b15f0b2efb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.081321 Jul 11 15:57:09.528342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 571/1135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:09.994070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:09.995368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:10.005484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.005975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.007059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.007634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.039576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7095d07c-b0fb-463e-8ef6-2e1d653a412d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051661 Jul 11 15:57:10.040157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 565/1136] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:10.048346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:10.049305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:10.056257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.056851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.058156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.058593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.089681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf43ea34-977e-476b-9b68-83f7908ab86e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Jul 11 15:57:10.090275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 572/1137] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:10.442286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:10.443777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:10.451893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.452272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.453071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.453498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.484427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-780da71e-8c1d-4379-aa70-575e8e9d2516 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048730 Jul 11 15:57:10.484981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 566/1138] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:10.552928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:10.553860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:10.563832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.564585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.565731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:10.566403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:10.629988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:10.638720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f725bb72-91e2-4f12-9fa8-5c9672c52a73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091758 Jul 11 15:57:10.639285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 573/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:11.057149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:11.058281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:11.064529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.064977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.065714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.066141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.096912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c6ba52f9-d386-4799-a1e6-7bca3bc62c32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Jul 11 15:57:11.097460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 567/1140] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:11.101929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:11.102858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:11.110279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.110808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.111572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.112001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.142437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d3fdc15-08b0-44ad-be29-0162228248b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Jul 11 15:57:11.143286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 574/1141] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:57:11.500948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:11.502318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:11.511811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.512265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.513054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.513487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.543317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af2d5d59-0d33-4b88-9e3d-f58d965997f2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Jul 11 15:57:11.543860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 568/1142] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:11.658342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:11.659341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:11.669739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.670486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.671749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:11.672522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:11.740552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:11.748940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96830b4d-f291-43ae-868d-125a54e76bc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097133 Jul 11 15:57:11.749471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 575/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:12.111325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:12.112568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:12.121624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.122204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.123193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.123756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.154896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:12.155418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-07ecc6af-24f5-4e8f-9342-5868ad26d5e8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049433 Jul 11 15:57:12.155732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:12.156206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 569/1144] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:12.164128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.164795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.165903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.166464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.199529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6166014-41ed-43f2-afd0-1792d98faac7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048820 Jul 11 15:57:12.200101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 576/1145] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:12.559133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:12.560063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:12.566521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.566970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.567720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.568149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.598346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c09b199-678a-42a4-9503-c533af617433 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Jul 11 15:57:12.598902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 570/1146] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:12.770191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:12.771224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:12.782224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.782962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.784336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:12.785083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:12.849121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:12.856982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc820942-ca9d-418c-83e6-98384125c57a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093263 Jul 11 15:57:12.857541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 577/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:13.172055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:13.173609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:13.183485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.183933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.184742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.185168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.211895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:13.213046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:13.215237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9a9abc1-ca1f-414a-88a3-26887561ad3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050686 Jul 11 15:57:13.215804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 571/1148] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:13.220335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.220799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.221562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.222002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.253813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-35df87b6-3710-4805-933f-bfedbaefcb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046380 Jul 11 15:57:13.254383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 578/1149] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:13.617429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:13.619670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:13.634208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.635420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.636516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.637188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.642644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:13.677219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15290d09-6ed1-4078-9a95-7ffab8ab6578 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070235 Jul 11 15:57:13.677792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 572/1150] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:13.874612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:13.875233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:13.884698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.885164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.886303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:13.886878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:13.908970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:13.953919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:13.966326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-563b9b67-d4ec-4f75-981f-55e2b795a7ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095935 Jul 11 15:57:13.966911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 579/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:14.227273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:14.228209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:14.235306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.235749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.236538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.236963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.267886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4356709e-ab19-4cef-b19c-257b5b875eaa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Jul 11 15:57:14.268621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 573/1152] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:14.269454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:14.270861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:14.280823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.281556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.282678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.283404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.315990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-503c299a-3b8e-4b96-93aa-7dec429d9909 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052420 Jul 11 15:57:14.316576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 580/1153] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:14.692680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:14.693819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:14.703778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.704615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.705791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.706414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.737151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4bfe95f4-1665-4cdd-8283-691aae2915c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051292 Jul 11 15:57:14.737696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 574/1154] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:14.984225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:14.984838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:14.991256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.991702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:14.992493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:14.992930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.054562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:15.062355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b433e65b-9ba5-4dea-aa37-cf65f139ecb9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.082197 Jul 11 15:57:15.062924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 581/1155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:15.285241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:15.286522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:15.295757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.296203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.296988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.297420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.327844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf4b44df-5f83-4b3e-a649-272f8c31c1ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049359 Jul 11 15:57:15.328085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:15.328755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 575/1156] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:15.328990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:15.336141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.336617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.337383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.337822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.367756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0efbee54-61d0-4f06-8263-360e7addb4d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043702 Jul 11 15:57:15.368319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 582/1157] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:15.752672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:15.754141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:15.763099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.763548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.764334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:15.764751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:15.794653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5bbf94fd-363e-4f01-9b50-324ce3db9eed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048639 Jul 11 15:57:15.795202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 576/1158] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:16.080246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:16.080887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:16.088587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.089263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.090233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.090719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.165463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:16.173697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e0f44af-1008-4c42-a100-c62dbcd940fb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097491 Jul 11 15:57:16.174266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:16.344001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:16.345525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:16.356461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.357214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.358448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.359177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.379328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:16.380262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:16.387153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.387606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.388418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.388857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.392804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15d64b5b-ef16-4464-901e-729eab8c4b17 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055628 Jul 11 15:57:16.393365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 577/1160] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:16.418665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ca4a7b32-5f0f-44e3-bfa0-006087c4deaa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Jul 11 15:57:16.419204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 584/1161] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:16.808715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:16.809631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:16.816173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.816645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.817389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:16.817813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:16.847026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-69fc8c21-6162-4b37-a776-159f0771bb0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Jul 11 15:57:16.847531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 578/1162] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:17.194857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:17.195387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:17.202812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.203259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.204016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.204479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.266507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:17.278233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15bcc3f7-01c7-4256-83fa-0bd3b4cada83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090119 Jul 11 15:57:17.278962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 585/1163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:17.408940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:17.410434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:17.419450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.419902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.420691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.421103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.429917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:17.430839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:17.437839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.438320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.439087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.439519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.450473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-60aa847c-1c49-45d3-a69e-bbd010097891 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Jul 11 15:57:17.450962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 579/1164] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:17.469807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e81dacf8-06fe-42e3-bfa1-e7573811eca6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043960 Jul 11 15:57:17.470363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 586/1165] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:17.861843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:17.863316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:17.872055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.872541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.873293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:17.873727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:17.903198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c640237e-5026-484c-9a58-302725cada32 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048017 Jul 11 15:57:17.904075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 580/1166] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:18.303013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:18.304019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:18.311573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.311997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.312798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.313234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.384328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:18.392067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aa54c7eb-0742-4542-b806-6659425ff1b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095528 Jul 11 15:57:18.392674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 587/1167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:18.466199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:18.467233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:18.475867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.476521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.477296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.477736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.482007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:18.483146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:18.489653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.490045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.490836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.491264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.508544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a19fb4c-0fdd-4497-9cb3-a78593637347 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Jul 11 15:57:18.509133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 581/1168] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:18.521475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-725df22b-9cff-480e-80d3-167b34900ee9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043497 Jul 11 15:57:18.522022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 588/1169] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:18.919235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:18.920165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:18.926833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.927282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.928033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:18.928571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:18.959077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d43ed6e-469a-48bf-a3d7-b3fde750114a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Jul 11 15:57:18.959625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 582/1170] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:19.413109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:19.414124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:19.421543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.422002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.422767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.423198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.485181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:19.493673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-677ee285-ca7f-4ae1-86aa-1f6e7eb26802 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087150 Jul 11 15:57:19.494319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 589/1171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:19.520976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:19.521892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:19.529053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.529504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.530271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.530703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.533068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:19.533985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:19.540324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.540807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.542338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.542775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.561134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6542ef9d-4b48-4c7a-aace-95de77e2576d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Jul 11 15:57:19.561700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 583/1172] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:19.573609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d3f95e0-c25d-4ca9-9f98-3c613222a5bf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 Jul 11 15:57:19.574190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 590/1173] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:19.970971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:19.972171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:19.978990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.979448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:19.980271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:19.980752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.011303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc08695a-a9ee-4087-ba9a-4816d779438d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Jul 11 15:57:20.011866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 584/1174] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:20.515537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:20.516412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:20.528001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.528789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.530031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.530757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.587071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:20.588051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:20.594738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.595178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.595923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.596350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.606983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:20.614843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f7fcc31-d073-4dfb-9bb5-861d141544a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.106285 Jul 11 15:57:20.615427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 591/1175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:20.626505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50145892-2d8d-4a0a-8a3f-2172f9ae1b21 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Jul 11 15:57:20.627038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 585/1176] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:57:20.630206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:20.631215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:20.637715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.638169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.638930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:20.639361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:20.667472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1b2faecc-b0e4-4a74-a359-3017cfdea959 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Jul 11 15:57:20.668026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 592/1177] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:57:21.027752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:21.029277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:21.039458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.040202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.041515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.041945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.071370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9f0641c1-7e62-4877-a9d3-4dca0c94bfcc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050475 Jul 11 15:57:21.071920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 586/1178] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:21.637226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:21.638169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:21.642310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:21.643767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:21.649212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.649959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.651023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.651458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.652898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.653340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.654083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.654507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.683963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ef345cd-bbd9-48fa-9283-43d704f08f3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048195 Jul 11 15:57:21.684576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 587/1179] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:21.689096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:21.689999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:21.695848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.696310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.697053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:21.697803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:21.717476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:21.723453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:21.725696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af3af7e4-97f5-4181-b5cb-1b71aaf76b51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095273 Jul 11 15:57:21.726345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 593/1180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:21.727920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c1fa471-f6c2-4ff2-bc09-8cf78cb40cd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Jul 11 15:57:21.728774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 588/1181] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:22.088774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:22.089740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:22.096332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.096790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.097564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.097997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.128140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6bc3b6cd-1983-45ba-b92b-112540a01aa4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047472 Jul 11 15:57:22.128734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 594/1182] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:22.696612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:22.699756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:22.709993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.710649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.711786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.712380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.741371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:22.742358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:22.748234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0f789ed0-6ee6-4461-8370-6064072f9923 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056022 Jul 11 15:57:22.748835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 589/1183] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:22.749288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.749738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.750507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.750932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.756075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:22.756795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:22.758622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:22.764684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.765106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.765877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:22.766312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:22.781459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43333984-75cf-47fb-bb8e-5533ebd1a888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Jul 11 15:57:22.782053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 595/1184] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:22.843051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:22.854524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-286cc7d1-11cd-4fbe-998f-52608da41f61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.104493 Jul 11 15:57:22.855201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 590/1185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:23.145789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:23.147298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:23.155105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.155562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.156329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.156791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.160472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:23.188791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c104a4c9-4b77-4eb1-aa2f-025a90102ba5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049675 Jul 11 15:57:23.189379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 596/1186] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:23.759882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:23.761004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:23.768088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.768588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.769381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.769829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.793960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:23.794884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:23.799933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7ab1d0ff-465b-467b-87de-e09b7f0072e3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044386 Jul 11 15:57:23.800525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 591/1187] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:23.801426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.801886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.802694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.803134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.839554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ef60abc-2b6c-47df-bcb9-73e92fecf358 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050093 Jul 11 15:57:23.840116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 597/1188] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:23.876041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:23.876718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:23.883085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.883534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.884304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:23.884751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:23.945815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:23.953844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-40e4ee52-33f1-46a4-90bd-0c86a0195152 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.081784 Jul 11 15:57:23.954713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 592/1189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:24.202125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:24.203080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:24.209906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.210350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.211223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.211654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.241167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1768aa07-1677-4170-94ac-b1ae47dbd50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Jul 11 15:57:24.241716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 598/1190] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:24.813699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:24.814930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:24.824189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.824671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.825427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.825895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.851337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:24.852352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:24.856608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb5e9018-2c36-4772-b0da-06ebc9c60c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048492 Jul 11 15:57:24.857172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 593/1191] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:24.859418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.859863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.860662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.861093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.890394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eee1cf4c-43b1-4c30-8800-3871554e86f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Jul 11 15:57:24.890987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 599/1192] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:24.975004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:24.975998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:24.983612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.984089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:24.984904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:24.985337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.050323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:25.058264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4127ae1a-e0d6-43ab-ad54-a335205092f3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089654 Jul 11 15:57:25.058827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 594/1193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:25.257313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:25.258804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:25.269051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.269788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.271029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.271748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.303867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98ed9ce7-e802-4d33-b4bc-52528903c90e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053224 Jul 11 15:57:25.304432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 600/1194] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:25.869916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:25.871050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:25.879676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.880229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.881204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.881737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.903423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:25.904454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:25.911234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.911681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.912486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:25.912919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:25.916039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b472d57-c49e-4dca-8dec-08e7d54b04eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051575 Jul 11 15:57:25.917664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 595/1195] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:25.944725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ff5d3103-59af-4a17-b0d4-35f4fd56f273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Jul 11 15:57:25.945305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 601/1196] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:26.080093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:26.081029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:26.090410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.090870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.091631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.092098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.162379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:26.170273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3cdb04eb-494f-4bf7-ae93-c551d115bc93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097196 Jul 11 15:57:26.170846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 596/1197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:26.319452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:26.321001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:26.327956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.328440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.329212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.329653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.360380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1101be11-a50e-4181-95d0-8fdbe2f2d961 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 Jul 11 15:57:26.360864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 602/1198] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:26.931483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:26.933294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:26.944222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.945022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.946277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.946973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.956436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:26.957362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:26.964717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.965169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.965932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:26.966374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:26.977861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a78d21ab-ed28-4f7e-860c-5b114d63bc54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053078 Jul 11 15:57:26.978515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 597/1199] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:26.995320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b15a0aec-23d4-480f-8a7a-8e02742db7c7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Jul 11 15:57:26.995873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 603/1200] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:27.191510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:27.192668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:27.200761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:27.201213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:27.201985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:27.202420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:27.267368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:27.275150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e05606d0-8699-47e9-8f9d-a617083f68c2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090014 Jul 11 15:57:27.275765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 598/1201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:27.378410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:27.379919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:27.390627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:27.391389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:27.392743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:27.393472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:27.425843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-454e3ee7-5ee9-438d-9083-2855068cff94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054152 Jul 11 15:57:27.426392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 604/1202] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:27.994506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:27.995880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:28.006903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.007840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.009153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.010112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:28.010594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.011007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:28.017975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.018465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.019204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.019632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.044584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a0ca65a4-b6cc-4cb5-af5f-9d09443d869c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056973 Jul 11 15:57:28.045149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 599/1203] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:28.048945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b54e05e5-9876-4f18-895b-2c1b6c6c68a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Jul 11 15:57:28.049504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 605/1204] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:28.295999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:28.297047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:28.307279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.307734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.308542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.308979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.380091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:28.389433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb90e8ed-9823-4c5f-8ea3-e7af43ca6210 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100774 Jul 11 15:57:28.390003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 600/1205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:28.442636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:28.444125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:28.452266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.452753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.453594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:28.454037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:28.484978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-13aefaf8-3761-4bad-8903-cb4aefa803ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049087 Jul 11 15:57:28.485578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 606/1206] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:29.056964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:29.058072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:29.060766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:29.061635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:29.065037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.065489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.066281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.066719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.068162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.068643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.069600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.070688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.096608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4fa1674-c9ca-484a-b0a5-a11b6e2263e1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043613 Jul 11 15:57:29.097200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 601/1207] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:29.100895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e0206f9a-06be-47de-ba60-ab5aa38d919b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Jul 11 15:57:29.101453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 607/1208] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:29.410548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:29.411595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:29.419829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.420643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.421586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.422074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.498202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:29.499120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:29.499285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:29.505195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.505638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.506398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:29.506807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ac9f6746-bae0-48fd-a678-50b51a6c9747 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102773 Jul 11 15:57:29.506915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:29.507366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 602/1209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:29.535963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52143f89-8393-4fd2-a61e-dc6a361d4f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041871 Jul 11 15:57:29.536533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 608/1210] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:57:30.112856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:30.114399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:30.117025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:30.118539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:30.125773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.126602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.127806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.128571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.129098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.129857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.131088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.131765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.161880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6fe94b09-a6e3-4f1f-857a-166ffe554674 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055603 Jul 11 15:57:30.162323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 603/1211] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:30.162872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3aa7c4cc-918d-4330-95bb-a50aafaf8b3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052396 Jul 11 15:57:30.163693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 609/1212] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:30.528678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:30.529422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:30.537817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.538416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.539410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.539988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.549364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:30.550622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:30.558362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.558820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.559591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:30.560003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:30.590466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9b6089e-3357-49d3-a72b-6b022deb89fe tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046545 Jul 11 15:57:30.591048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 610/1213] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:30.606220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:30.613919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c9674ef-6864-4d12-9b99-f962dd09fa4d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091246 Jul 11 15:57:30.614477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 604/1214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:31.178287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:31.179114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:31.179696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:31.180360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:31.187369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.187682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.188008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.188160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.188824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.188959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.189286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.189437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.206896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:31.219897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bdecbdfc-bfd5-48f9-9dd4-fbf4679ee52f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048485 Jul 11 15:57:31.220795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 611/1215] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:31.220939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e4174515-83b3-4a09-bad5-b9b9c70ef481 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048797 Jul 11 15:57:31.221468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 605/1216] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:31.606006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:31.607126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:31.615057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.615611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.616586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.617124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.632210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:31.633110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:31.639985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.640476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.641244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:31.641678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:31.646167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:31.650881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49569d2d-37bf-4e00-8bcb-8b0f7e25aa22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051144 Jul 11 15:57:31.651437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 612/1217] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:31.702901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:31.715693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0af32e24-e7e6-4e2c-90c0-014afb06d606 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088064 Jul 11 15:57:31.716592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 606/1218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:32.232330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:32.233338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:32.240025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.240529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.241288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.241718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.271558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5a9468a4-9478-4171-b1c5-2891f9a53d12 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043503 Jul 11 15:57:32.272118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 613/1219] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:32.284959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:32.285872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:32.292256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.292730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.293477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.293905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.323554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1a57f8f6-c9da-4fd7-ac80-7f31ca21e26d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095014 Jul 11 15:57:32.324120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 607/1220] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:32.664242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:32.665412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:32.674263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.674837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.675788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.676342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.708571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8f4fb6c-7de8-49c8-9195-1415d95dfc7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049394 Jul 11 15:57:32.709139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 614/1221] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:32.732987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:32.733597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:32.741895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.742488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.743876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:32.744503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:32.817412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:32.828461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2fcc1c3d-db7f-44ae-8e5a-9d2518e0521a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099092 Jul 11 15:57:32.829168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 608/1222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:33.287696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:33.289105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:33.296718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.297203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.297963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.298398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.328056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b12e15c-85b1-4893-9ed7-adabb6a21c6d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046597 Jul 11 15:57:33.328662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 615/1223] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:33.335784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:33.336745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:33.343727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.344172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.344965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.345395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.375140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6be50217-376c-44ca-b5ee-23da25f552a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Jul 11 15:57:33.375685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 609/1224] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:33.725087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:33.726563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:33.734413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.734868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.735632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.736068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.765984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ebdb4747-0c4f-484b-b331-bd9b101c05c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Jul 11 15:57:33.766536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 616/1225] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:33.851795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:33.852622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:33.859244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.859690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.860491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:33.860926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:33.925262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:33.936076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b2fb7f23-5cf3-4d8a-b186-761e359ea454 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090452 Jul 11 15:57:33.936681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 610/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:34.344533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:34.346018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:34.349025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:34.358237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.358993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.360251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.361015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.387414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:34.388345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:34.393789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb40a483-54cc-4043-a203-a49013e8f2c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056397 Jul 11 15:57:34.394381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 617/1227] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:34.395050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.395503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.396267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.396746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.426494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b27550ff-8e1b-4d08-a6a6-aed63419fc75 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Jul 11 15:57:34.427011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 611/1228] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:34.782080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:34.783560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:34.793105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.793553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.794311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.794746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.824252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9fc04033-b621-45c5-bd14-5ba6f5c08f4a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Jul 11 15:57:34.824835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 618/1229] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:34.958308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:34.959245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:34.967457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.967906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:34.968701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:34.969446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.033217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:35.044524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5f8b4814-1467-4a7a-9b41-df82ce5a6733 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092261 Jul 11 15:57:35.045329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 612/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:35.410319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:35.411847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:35.419709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.420160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.420946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.421380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.439308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:35.440241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:35.447291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.447776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.448587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.449018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.451276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11c02165-0755-410d-a7a3-fa5639f7371c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047740 Jul 11 15:57:35.452048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 619/1231] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:35.479713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2ab723c-c78b-4fd9-9160-dacd9fa05490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Jul 11 15:57:35.480275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 613/1232] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:35.836501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:35.837601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:35.845224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.845682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.846447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:35.846877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:35.878177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1381088c-760d-4327-9046-26662ef1bbf7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Jul 11 15:57:35.878727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 620/1233] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:36.070022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:36.071038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:36.078027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.078480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.079242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.079674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.155247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:36.163554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66eddaeb-04ff-4c2d-934b-cfc94b1f1e74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099986 Jul 11 15:57:36.164118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 614/1234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:36.467119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:36.468153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:36.476103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.476708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.477656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.479316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.492703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:36.493952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:36.500985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.501426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.502174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.502601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.513880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b8d21210-b73a-4f31-b4a9-f687f6324fa6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052306 Jul 11 15:57:36.514445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 621/1235] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:36.537968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d2a05382-90c8-4309-a513-6e586396642f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050260 Jul 11 15:57:36.538549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 615/1236] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:36.895764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:36.897291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:36.908252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.908998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.910293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:36.911053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:36.942991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ff96776d-c03f-4342-9804-82cad87caed8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053881 Jul 11 15:57:36.943537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 622/1237] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:37.184274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:37.184985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:37.192888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.193486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.194475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.195013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.259599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:37.267298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ed168a6c-dc03-425f-a968-707ec14666b6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088981 Jul 11 15:57:37.267865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 616/1238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:37.530711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:37.532061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:37.541878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.542322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.543076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.543500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.550437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:37.551346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:37.558474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.559462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.559641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.560110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.574074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9dbcb693-28f5-491a-9708-12714846e985 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050184 Jul 11 15:57:37.574639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 623/1239] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:37.590584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5ddb1c4-de2d-4159-907e-c62e3befed8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Jul 11 15:57:37.591134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 617/1240] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:37.955092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:37.956047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:37.963541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.963992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.964798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:37.965236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:37.995554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-da5325ae-e7bf-4c99-8583-a8aeb501f176 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Jul 11 15:57:37.996109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 624/1241] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:38.285790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:38.286375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:38.293179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.293623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.294371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.294804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.360610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:38.371231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1ecf2ff-7aeb-4a8b-af3d-3e0fea80955e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089520 Jul 11 15:57:38.372025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 618/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:38.587398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:38.588302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:38.595168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.595619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.596415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.596833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.602280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:38.603802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:38.610580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.611051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.611811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:38.612230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:38.626172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eb683ac1-d751-4a71-8ccc-b8933ad97b3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042844 Jul 11 15:57:38.626757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 625/1243] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:38.641726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa11676e-a947-4076-a872-f9d86d285e84 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Jul 11 15:57:38.642284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 619/1244] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:39.010982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:39.011995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:39.019688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.020278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.021153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.021633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.053504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11b5b45f-ec73-483a-b361-caba32e0b2ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048789 Jul 11 15:57:39.054041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 626/1245] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:39.397095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:39.398094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:39.405526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.405987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.406776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.407230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.471042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:39.479173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f320430f-112a-4333-ba20-8d56ad2f080f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088475 Jul 11 15:57:39.479735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 620/1246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:39.642556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:39.644009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:39.652962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.653379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.654140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.654474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:39.654916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.655495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:39.662154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.662598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.663345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:39.663773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:39.684830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-75ea059b-f8d9-48f5-a2ff-dddac4ae9f56 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049156 Jul 11 15:57:39.685406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 627/1247] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:39.693370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0fdea63f-017a-4dbf-b0e4-fcae2f377d5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Jul 11 15:57:39.693921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 621/1248] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:40.069433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:40.070920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:40.081941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.083039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.084483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.085199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.115886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-99e2b57e-728e-4e92-a9d3-f0dad2b68804 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053097 Jul 11 15:57:40.116461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 628/1249] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:40.500247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:40.501157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:40.510543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.510985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.511724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.512150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.516054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:40.574622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:40.586335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27cfbbaa-811c-49ea-962d-18b389181f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092849 Jul 11 15:57:40.587152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 622/1250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:40.699750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:40.700810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:40.705201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:40.706248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:40.708179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.708722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.709575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.710050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.713764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.714262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.715122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:40.715568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:40.730419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:40.745383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b45a93e-9284-4b7d-9f63-59d71f08d2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051114 Jul 11 15:57:40.745974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 629/1251] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:40.746959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d68d38a9-30dc-4bfc-bb8d-13664db9c41f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Jul 11 15:57:40.747632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 623/1252] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:41.132418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:41.133941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:41.145226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.145965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.147289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.147992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.178002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-104b010e-4031-4023-a7bb-3c946a84c82a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052181 Jul 11 15:57:41.178557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 630/1253] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:41.606625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:41.607623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:41.617825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.619070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.619608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.620040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.693401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:41.701629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e3f1584d-f65b-4752-b405-a6f61aaca337 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101645 Jul 11 15:57:41.702228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 624/1254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:41.757398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:41.757954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:41.758353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:41.758706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:41.765260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.765464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.765704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.765914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.766466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.766680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:41.766899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.767095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:41.796428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ecb1313f-de75-4303-b922-263336425e37 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Jul 11 15:57:41.796944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2ff7e3b5-3757-4f3e-8276-969811265c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043705 Jul 11 15:57:41.797091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 625/1255] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:41.797497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 631/1256] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:42.193677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:42.195649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:42.202648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.203093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.203851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.204274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.234450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc841470-6b6d-49a5-837c-b8b225851f6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Jul 11 15:57:42.234987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 626/1257] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:42.723513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:42.724590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:42.733143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.733595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.734345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.734777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.800252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:42.808519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a499861-6aa5-4a26-8df8-9bec56cb2f16 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091408 Jul 11 15:57:42.808994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:42.809481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 632/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:57:42.810009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:42.814297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:42.815247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:42.816746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.817220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.818216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.818352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.821403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.823042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.823042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:42.823272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:42.847583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47754968-d9aa-4391-b81d-989ac549db06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Jul 11 15:57:42.848134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 627/1259] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:42.855796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-75829f83-6cf9-416a-bb94-beb7cc581745 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045660 Jul 11 15:57:42.856346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 633/1260] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:43.246637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:43.247600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:43.254062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.254535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.255294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.255731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.290220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d2244f92-597b-4cad-9bae-2cbd5a703aed tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047900 Jul 11 15:57:43.290768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 628/1261] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:43.829703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:43.830632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:43.840245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.840722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.841488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.841923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.859573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:43.860497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:43.867427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.867989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.868915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.869557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.899353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-897d0c36-3583-4068-a089-951c45f51a52 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Jul 11 15:57:43.900084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 629/1262] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:43.904879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:43.905271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:43.905780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:43.911852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.912328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.912960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-237bdf67-4a6e-44db-8e8c-f400a62ee315 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089870 Jul 11 15:57:43.913103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:43.913742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:43.913881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 634/1263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:43.943046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-972a5166-2403-4753-832c-937b835adebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041731 Jul 11 15:57:43.943590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 630/1264] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:44.306230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:44.307788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:44.318081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.318820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.320067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.320831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.351636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d298ba5-8a93-43d4-858e-39887a3ba2d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052120 Jul 11 15:57:44.352160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 635/1265] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:44.914472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:44.916272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:44.923273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.923742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.924578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.924918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.930488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:44.931339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:44.938010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.938464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.939233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.939670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.955602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-25bb01d3-4eeb-4051-b805-1bfd2f454980 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Jul 11 15:57:44.956310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 631/1266] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:44.965047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:44.966652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:44.973924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.974366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:44.975124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:44.975551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:45.005086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4fb43b46-359f-48aa-a123-c11e57bb0d8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047430 Jul 11 15:57:45.005661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 632/1267] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:45.006956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:45.015342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2ea6d04-c701-47cf-b233-63061968324c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088418 Jul 11 15:57:45.016064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 636/1268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:45.366152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:45.367084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:45.373459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:45.373908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:45.374666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:45.375098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:45.405037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c83ad2c-c97f-413d-9c5b-b3968ac1f4cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Jul 11 15:57:45.405594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 633/1269] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:45.967131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:45.968056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:45.974582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:45.975028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:45.975783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:45.976187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.005679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a755ce78-d3d1-4343-8f66-ee628371ed15 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jul 11 15:57:46.006263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 637/1270] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:46.017064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:46.017984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:46.024565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.025029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.025781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.026224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.033655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:46.033884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:46.040529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.041082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.041855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.042337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.057406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-105fbae6-38ae-41ab-a0d1-32d2be5ace0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044215 Jul 11 15:57:46.057986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 634/1271] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:46.107224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:46.115355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf24f27f-58df-48a5-8c4d-6013fa86cbdf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086452 Jul 11 15:57:46.115987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 638/1272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:46 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:57:46.420722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:46.421746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:46.428922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.429379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.430248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:46.430731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:46.463354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-97c78392-f7de-44c2-91cb-8b730c8d398d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Jul 11 15:57:46.463853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 635/1273] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:47.018060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:47.018897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:47.025995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.026442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.027216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.027648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.057781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42d5d43a-43de-4e9c-9a7b-3aa11f664065 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Jul 11 15:57:47.058353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 639/1274] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:47.069862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:47.070821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:47.077473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.077996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.078820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.079341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.111193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-67c7ba29-9e56-43da-a7f5-d3a74d0fecf6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045812 Jul 11 15:57:47.111766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 636/1275] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:47.132791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:47.133820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:47.140471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.140992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.141763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.142193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.206254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:47.214405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e83aeaa0-402b-49bd-8eb0-222dfa29edef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085595 Jul 11 15:57:47.214970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 640/1276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:47.478973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:47.479895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:47.486336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.486782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.487532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:47.487961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:47.517297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4188ef71-f314-4f7f-b205-b3a147017c8c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jul 11 15:57:47.517836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 637/1277] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:48.078619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:48.079828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:48.090556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.091171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.092372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.092989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.123089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:48.123999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:48.125745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43d5f80a-616c-41a8-920e-77744fec46bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053535 Jul 11 15:57:48.126305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 641/1278] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:48.130987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.131434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.132196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.132666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.156949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:48.161398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64514bfc-0a35-4404-a25e-31cde7da83d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042303 Jul 11 15:57:48.161956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 638/1279] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:48.231307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:48.231957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:48.238478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.238925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.239676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.240104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.301869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:48.310052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fa8aa96-2ec4-4045-a77d-037bc234c602 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.082687 Jul 11 15:57:48.310607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 642/1280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:48.532985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:48.534414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:48.544870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.545616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.546861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:48.547582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:48.580049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d216468e-58f1-4331-90e5-0c44842e1ba1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054406 Jul 11 15:57:48.580640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 639/1281] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:49.141946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:49.143548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:49.152871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.153320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.154099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.154526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.172718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:49.173748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:49.176007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:49.182314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.182761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.183624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.183839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-445b78a0-0073-42e6-b749-f42a6f80c9ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048724 Jul 11 15:57:49.183959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.184680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 643/1282] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:49.214462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-04ea16dc-c00f-4da5-817c-9be328b885e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Jul 11 15:57:49.215011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 640/1283] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:49.331339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:49.332702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:49.340973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.341424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.342193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.342629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.415458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:49.423376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66001471-a0e1-4c66-9776-3666d6fdf412 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098676 Jul 11 15:57:49.423972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 644/1284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:49.596374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:49.597946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:49.606699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.607152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.607914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:49.608377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:49.638907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c2849689-cd3a-417f-a58c-d89c63412863 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Jul 11 15:57:49.639456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 641/1285] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:50.197059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:50.198065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:50.205309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.205756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.206520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.206951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.226347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:50.227266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:50.235119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.235571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.236321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.236781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.236921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d540cd2a-b38e-4b21-88dc-a448980a5b60 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Jul 11 15:57:50.237511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 645/1286] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:50.266940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56a9bd8e-26b2-4e8e-b522-2142b4b913d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044567 Jul 11 15:57:50.267536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 642/1287] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:50.440794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:50.441619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:50.449269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.449657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.450422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.450846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.454922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:50.527136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:50.537720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-27032f40-c17e-4bb0-a911-f7685a62b381 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100415 Jul 11 15:57:50.538051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 646/1288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:50.653051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:50.654094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:50.661705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.662174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.663327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:50.663838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:50.697850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dfd85d4b-516c-4287-a7ac-a2caa09604f4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049346 Jul 11 15:57:50.699077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 643/1289] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:51.251498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:51.253081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:51.261918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.262366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.263128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.263554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.279570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:51.280516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:51.287358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.287806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.288617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.289070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.295064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd4e33e3-757a-4c28-accb-650b232b419a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049652 Jul 11 15:57:51.295650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 647/1290] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:51.319434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06314bc8-df5e-46e9-a690-7c8d15d496f5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Jul 11 15:57:51.319987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 644/1291] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:51.555122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:51.556005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:51.562699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.563156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.563917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.564384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.631736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:51.640203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-493c5337-78bf-4ccd-b66e-4353bf443ef5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089266 Jul 11 15:57:51.640806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 648/1292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:51.716594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:51.718072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:51.728576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.729028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.729832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:51.730216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:51.760746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1bc9fe7c-7a53-424f-8e46-47ece8e22c6e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051755 Jul 11 15:57:51.761351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 645/1293] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:52.308646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:52.309606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:52.316570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.317025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.317790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.318212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.331318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:52.332714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:52.339815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.340227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.341061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.341492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.348714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d4e4eabc-3e27-4f28-a864-345b686fca41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Jul 11 15:57:52.349479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 649/1294] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:52.370585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-85c66740-1f99-462f-b9c4-9b4a87560143 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043283 Jul 11 15:57:52.371113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 646/1295] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:52.660803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:52.661805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:52.669652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.670134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.670892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.671328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.743109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:52.753200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e533443b-f649-485b-b3a2-b0d6d6ddcc51 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099006 Jul 11 15:57:52.753924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 650/1296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:52.772917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:52.773905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:52.780140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.780617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.781372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:52.781799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:52.812128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-68021dc2-9339-4580-b3ff-5e6b7c64f36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Jul 11 15:57:52.812672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 647/1297] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:53.364656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:53.366157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:53.377136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.377929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.379179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.379910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.385766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:53.386688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:53.393412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.393853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.394602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.395027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.411601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b4f6d64-562b-4c43-bf77-753b63692992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Jul 11 15:57:53.412140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 651/1298] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:57:53.424336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5ee8d9bf-a965-4236-a9b4-243d55b21336 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Jul 11 15:57:53.425055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 648/1299] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:53.775484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:53.776102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:53.783127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.783566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.784569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.785000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.823561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:53.824514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:53.830934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.831384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.832175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:53.832956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:53.850260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:53.859514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bbb7995d-9119-4623-b59d-c0c7a0d72132 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090421 Jul 11 15:57:53.860226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 652/1300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:53.866683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1aecaff0-da79-48b1-b92a-81ae80d62279 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Jul 11 15:57:53.867213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 649/1301] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:54.427741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:54.429306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:54.436376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:54.437254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.437437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:54.437757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.438608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.439068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.446953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.447188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.448577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.449382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.469652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57671021-73eb-4b7c-982f-db83f9f9a30e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Jul 11 15:57:54.470456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 653/1302] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:54.481174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a80e6ee7-b877-4ca4-a04b-f934bca1077e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048947 Jul 11 15:57:54.481742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 650/1303] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:54.881861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:54.882601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:54.882830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:54.884132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:54.890055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.890496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.890749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.891186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.891345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.891690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.891922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:54.892531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:54.921721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-180c05ff-e6f3-48a5-a995-b166cbad6917 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Jul 11 15:57:54.922277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 651/1304] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:54.959325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:54.970228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6b485609-23ae-4e7d-b0da-29be807545a1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094597 Jul 11 15:57:54.971102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 654/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:55.486036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:55.487506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:55.497737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:55.498532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.499211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:55.499479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.500505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.501222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.509883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.510333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.511091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.511524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.532784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdcbde45-5153-48f0-9cea-89e4966e701e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Jul 11 15:57:55.533339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 652/1306] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:55.543160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-803227f5-252e-432e-9928-1061ab392385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052701 Jul 11 15:57:55.543694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 655/1307] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:55.935267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:55.936193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:55.942923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.943372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.944117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.944585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.974212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-99193e88-a762-419b-8225-c351f8c45908 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Jul 11 15:57:55.974756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 653/1308] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:55.989706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:55.990320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:55.997004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.997466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:55.998204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:55.998647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.062851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:56.070890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-213d9941-992b-43c8-88fe-ee9d07a1b3b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085141 Jul 11 15:57:56.071712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 656/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:56.545544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:56.546475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:56.553285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.553731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.554558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.554779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:56.555240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.555964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:56.562667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.563113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.563872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.564346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.584547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ae2d3c24-e8b3-48e4-b672-fcd1a6f240bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jul 11 15:57:56.585103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 654/1310] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:56.594812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a577a82c-35c2-4e6a-a51a-3f8e84cc8e75 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043997 Jul 11 15:57:56.595377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 657/1311] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:56.986162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:56.987092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:56.993574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.993993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:56.994771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:56.995197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.014548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:57.027903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-458593f8-ab0d-43e5-934c-c43e3ce101c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Jul 11 15:57:57.028491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 655/1312] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:57.095887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:57.096821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:57.105557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.106003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.106776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.107212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.169518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:57.177060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cada56e2-dea4-4b41-a2cb-66f584cf2598 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086759 Jul 11 15:57:57.177634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 658/1313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:57.600080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:57.601163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:57.609135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:57.610501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:57.610761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.611365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.612133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.612600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.617417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.617835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.618742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:57.619168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:57.642499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d5d926d-8af5-4629-90e0-74f223ca138b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Jul 11 15:57:57.643072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 656/1314] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:57.650771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9dfc295e-22bc-4604-bcf2-b08c117af552 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047988 Jul 11 15:57:57.651323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 659/1315] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:58.042633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:58.043644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:58.050614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.051108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.051978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.052483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.082217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1cfa3101-8bf6-4a65-95ac-58865ad66028 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Jul 11 15:57:58.083068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 657/1316] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:58.257251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:58.258247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:58.269166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.269916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.271193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.271952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.336030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:58.344716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0cd717e-db54-40bc-968e-141cf3f2d481 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094168 Jul 11 15:57:58.345277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 660/1317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:58.658553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:58.660050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:58.665554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:58.666525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:58.668896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.669344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.670117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.670637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.673242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.673689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.674466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:58.674896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:58.700096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87b56b1d-8e65-4ec2-9b67-739711c20f7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Jul 11 15:57:58.700919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 658/1318] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:58.705686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f096254c-46af-4fc7-8b12-6e89b09d33b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046806 Jul 11 15:57:58.706265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 661/1319] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:57:59.098455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:59.099977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:59.110649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.111434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.112741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.113497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.145454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-26953171-01a9-4344-959f-b1274ebaabe0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053765 Jul 11 15:57:59.146001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 659/1320] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:59.365615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:59.366659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:59.377150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.377898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.379214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.379936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.442835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:57:59.446318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:59.451077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bf88ee65-25d4-4f69-be93-9bb740eb19a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092027 Jul 11 15:57:59.451664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 662/1321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:57:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:57:59.714957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:59.715789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:59.719067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:57:59.719985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:57:59.722848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.723263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.724032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.724507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.726704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.727147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.727892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:57:59.728320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:57:59.753761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a207c9dd-b20d-4d87-8d4f-30a5e6d5c388 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Jul 11 15:57:59.754322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 660/1322] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:57:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:57:59.758217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c2f3c376-700b-4676-82e1-07c6230ade7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043046 Jul 11 15:57:59.758806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 663/1323] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:57:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:00.162460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:00.163983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:00.171045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.171488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.172237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.172693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.202529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dcbb89bd-3a4b-4ba4-a33b-86d7e9c1c8e6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Jul 11 15:58:00.203083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 661/1324] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:00.472170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:00.473101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:00.483403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.484152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.485457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.486199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.571415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:00.583195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-adaaf319-78b8-4d7e-934c-f4e4659fa90c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.117160 Jul 11 15:58:00.583938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 664/1325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:00.766562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:00.767389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:00.770467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:00.771381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:00.774127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.774792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.775579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.776003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.778006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.778459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.779208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:00.779639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:00.805490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12049d40-ffd9-4b5e-b54c-b60ecd70203c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042933 Jul 11 15:58:00.806059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 662/1326] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:00.809277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-06deb016-dd31-4b1d-a440-d52d794b7385 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 Jul 11 15:58:00.809819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 665/1327] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:01.216647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:01.217570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:01.224021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.224499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.225247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.225671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.254717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c242e5c0-1464-4f42-a83c-2bddd6cf53d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Jul 11 15:58:01.255275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 663/1328] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:01.604554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:01.605317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:01.613468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.614029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.614981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.615529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.684620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:01.696118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5bf922df-d418-415b-89e8-cc50fc93debb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097931 Jul 11 15:58:01.696773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 666/1329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:01.818881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:01.819951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:01.822093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:01.823150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:01.825394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:01.828041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.828608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.829505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.830009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.831829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.832987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.833880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:01.834435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:01.860244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a4b48cd-23ad-4ec0-aa59-ffecf2e4ace7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Jul 11 15:58:01.860735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 664/1330] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:01.870193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8caaa849-6329-49a7-aa24-e384a43530cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052784 Jul 11 15:58:01.870760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 667/1331] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:02.270569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:02.272064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:02.282307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.283035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.284371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.285103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.316611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba2cd489-90e9-4f53-b4aa-d8fc3364e44d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052674 Jul 11 15:58:02.317152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 665/1332] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:02.714906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:02.715552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:02.722533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.722988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.723754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.724187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.803666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:02.814437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ddcc2d74-ad82-4812-9c06-3bce2d3c9a8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103983 Jul 11 15:58:02.815013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 668/1333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:02.872096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:02.873077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:02.880011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.880502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.881166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:02.881658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.881658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.882093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:02.888583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.889031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.889790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:02.890227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:02.912312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9bc7ea12-4170-4a0b-8983-907a3a1887c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Jul 11 15:58:02.912911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 666/1334] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:02.919400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de6db294-ca4c-40ec-8ea4-6f6133e3e175 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042368 Jul 11 15:58:02.919990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 669/1335] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:03.333619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:03.335123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:03.343203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.343656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.344453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.344889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.375899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64b6d370-4f1f-40ed-bfbf-19542c15530f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Jul 11 15:58:03.376560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 667/1336] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:03.832761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:03.833414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:03.840331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.840806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.841572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.842007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.905046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:03.913050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e5412dc9-bf3f-4b5a-a992-abec7fcec7b9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084612 Jul 11 15:58:03.913653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 670/1337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:03.925025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:03.926032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:03.931209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:03.932153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:03.933545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.933961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.934683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.935184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.938506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.938947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.939701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:03.940129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:03.966395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5a951776-d891-4803-b856-4a157f0dfc64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Jul 11 15:58:03.967596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 668/1338] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:03.975126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2f56e9d1-2047-4ca8-a448-e8b55c960123 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047978 Jul 11 15:58:03.975929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 671/1339] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:04.392763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:04.394128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:04.405327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.405805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:04.407102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.407805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:04.439778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-20b22f24-a91c-437c-b25c-14d8a8a460ad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053181 Jul 11 15:58:04.440404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 669/1340] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:04.933001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:04.933611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:04.940660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.941100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:04.941847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.942293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:04.981136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:04.982513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:04.990949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.991462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:04.992585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:04.993371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:05.013031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:05.020664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17f4afc7-76ef-4a50-a405-b2c9d8f6380d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093483 Jul 11 15:58:05.021244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 672/1341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:05.022609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-51d64171-df86-48d2-905b-453a7784ac57 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Jul 11 15:58:05.023341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 670/1342] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:05.025974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:05.026884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:05.032891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:05.033348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:05.034105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:05.034541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:05.062981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-86d50e35-c03c-4149-a187-e33e22117ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040717 Jul 11 15:58:05.063535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 673/1343] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:05.452403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:05.453321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:05.460462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:05.460935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:05.461733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:05.462182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:05.492534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-07adc040-a3ff-4872-bdd5-0f856fc15011 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jul 11 15:58:05.493057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 671/1344] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:06.039570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:06.040733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:06.041835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:06.042500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:06.048736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.049284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.050397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.050562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.050887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.051064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.051902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.052477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.057429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:06.085962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ad4a4d8-9a85-4df6-8613-6029fb44eb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053458 Jul 11 15:58:06.087319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 674/1345] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:06.091196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:06.092106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:06.098382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.098840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.099612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.100052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.118458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:06.126166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3cb2d6f7-d0da-4412-ab2e-af4e9e6c5a69 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090752 Jul 11 15:58:06.126726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 672/1346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:06.130344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fb14066-e564-42fd-86ac-13307ad7f444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042752 Jul 11 15:58:06.130882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 675/1347] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:06.506846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:06.507956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:06.516277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.516921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.517930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:06.518512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:06.549412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4283cd6-1809-4612-b9a3-2e7267add118 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048015 Jul 11 15:58:06.549961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 673/1348] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:07.101783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:07.103547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:07.114786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.115527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.116814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.117527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.142525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:07.143539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:07.147119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-980b213b-cbb1-462f-95f2-eb331ecd402e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051744 Jul 11 15:58:07.147393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 676/1349] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:07.151371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.151816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.152330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:07.152614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.152929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:07.153084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.159176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.159617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.160388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.160821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.182913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cbf1ff4b-575b-484e-a0be-abf446e1bbf7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044402 Jul 11 15:58:07.183701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 674/1350] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:07.230073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:07.238223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5dfb86d1-7c6b-4313-9f61-11f9b6ae615a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089823 Jul 11 15:58:07.238718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 677/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:07.564353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:07.565676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:07.573910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.574393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.575144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:07.575577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:07.604634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2dbefbc4-6ae1-4f41-b8ab-075057b107dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Jul 11 15:58:07.605172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 675/1352] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:08.162890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:08.164411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:08.171663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.172124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.172932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.173375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.194605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:08.195775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:08.202553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.203006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.203781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.204335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c78337b8-aa28-4f09-9c89-b4c80e975fa9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048114 Jul 11 15:58:08.204502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.204940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 678/1353] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:08.234521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-71ab3a7d-e4ad-4120-9436-7e4d399d93f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043994 Jul 11 15:58:08.235073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 676/1354] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:08.255513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:08.256126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:08.262534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.262976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.263728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.264186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.282477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:08.329212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:08.337321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6399a0ae-1b64-4758-afca-da995d3fa26b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085775 Jul 11 15:58:08.337882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 679/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:08.619803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:08.620755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:08.627191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.627634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.628434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:08.628872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:08.657687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a59f31c-c75c-4c28-a450-1b8d9d427c01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Jul 11 15:58:08.658234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 677/1356] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:09.216784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:09.217717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:09.224957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.225324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.226097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.226536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.246220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:09.247230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:09.254066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.254513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.255274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.255709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.258126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57ee5df3-8eff-47ee-a01a-cf2899593713 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Jul 11 15:58:09.258734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 680/1357] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:09.285176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8189e25e-53f0-4950-9199-c61dc90f9586 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043358 Jul 11 15:58:09.285725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 678/1358] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:09.353608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:09.354222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:09.360490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.360950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.361718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.362177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.426993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:09.434999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-90a28936-d33c-4f41-b6c1-081f557977f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085377 Jul 11 15:58:09.435567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 681/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:09.669653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:09.670582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:09.677132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.677582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.678335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:09.678747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:09.708351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00aa3edf-06a0-4eb1-add4-1f616d866746 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042680 Jul 11 15:58:09.708919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 679/1360] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:10.274474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:10.275442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:10.282482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.282988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.284034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.284683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.300184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:10.301431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:10.309528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.309982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.310754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.311178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.320630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a057bf5-d523-41ce-a9cf-68d6d47db081 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Jul 11 15:58:10.321222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 682/1361] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:10.340799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-740e1531-0469-4215-b52a-c63a0a175ebd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046767 Jul 11 15:58:10.341319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 680/1362] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:10.453407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:10.454113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:10.462680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.463272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.464264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.464880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.532430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:10.540456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c2a0619-46dd-4873-a8b8-20ffee37f186 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092177 Jul 11 15:58:10.541014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 683/1363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:10.719565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:10.720440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:10.727083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.728077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.728878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:10.729312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:10.759261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-800e09ee-8688-46b1-8fc2-76c26e704602 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Jul 11 15:58:10.759850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 681/1364] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:11.334461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:11.335529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:11.343586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.344253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.345167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.345681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.354226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:11.355313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:11.361735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.362609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.362952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.363377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.379568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a9864c6a-2014-4bb6-887c-d01f5b7b6fd9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050074 Jul 11 15:58:11.384333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 684/1365] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:11.401042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4fc5781-1a6d-4549-af34-e9b28280c879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051321 Jul 11 15:58:11.401902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 682/1366] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:11.557464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:11.558072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:11.564531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.564980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.565749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.566186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.629889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:11.637900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4bab7a87-6354-4821-81eb-1dcb6f8953c4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084948 Jul 11 15:58:11.638462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 685/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:11.771417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:11.772329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:11.779122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.779582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.780354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:11.780792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:11.811314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e65ec4c8-fb3c-4573-93fd-171bb82b7663 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Jul 11 15:58:11.811763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 683/1368] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:12.397868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:12.404476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:12.408160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.408751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.409640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.410256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.412464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:12.413473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:12.419542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.419986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.420775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.421209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.443912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2440c5e8-4d60-4231-92e7-7bd958de098c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053981 Jul 11 15:58:12.444613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 686/1369] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:12.450375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a1af8d0a-73ff-4e88-8b34-89bdd0ddc982 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041935 Jul 11 15:58:12.450906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 684/1370] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:12.657171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:12.658031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:12.666271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.666720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.667471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.667900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.738023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:12.745799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c4163a7-731f-456a-b428-d70067a3b214 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094298 Jul 11 15:58:12.746379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 687/1371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:12.826058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:12.826991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:12.834210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.834657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.835408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:12.835838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:12.866490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-962968e8-1427-49e8-8dd1-48e471be77fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Jul 11 15:58:12.867041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 685/1372] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:13.459379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:13.460690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:13.465988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:13.467491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:13.472158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.472937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.474122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.474791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.478219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.478662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.479422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.479850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.506009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-768328f0-dc45-4e90-ae02-cfb303472297 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053296 Jul 11 15:58:13.506578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 688/1373] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:13.510185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b453434a-594c-4403-a9d1-ebadb2f58b26 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050681 Jul 11 15:58:13.510754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 686/1374] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:13.770269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:13.770827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:13.777845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.778318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.779111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.779570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.848872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:13.859918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b7351dc-d6c2-49f6-9b3f-c870b678d12c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093865 Jul 11 15:58:13.860548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 689/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:13.878310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:13.879258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:13.886205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.886649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.887401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:13.887921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:13.917155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8fbe9d86-ad65-4fd5-9602-d37ddbcdc6f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Jul 11 15:58:13.917737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 687/1376] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:14.518518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:14.519357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:14.521368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:14.522263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:14.526398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.526844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.527665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.528105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.528765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.529215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.529980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.530415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.556219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:14.559085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-603bb4d6-a2b2-4cd4-87ef-19c11a720ae9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Jul 11 15:58:14.559759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 690/1377] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:14.561121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-25b5ad74-3365-4b45-b514-04e34a4f3d0e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043799 Jul 11 15:58:14.561827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 688/1378] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:14.882916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:14.883910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:14.896016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.897199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.898550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.899371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.929343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:14.930343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:14.938503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.938956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.939777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:14.940147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:14.970563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:14.972761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e21d3f71-fbb6-4031-94c9-6caeba1130db tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047618 Jul 11 15:58:14.973356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 689/1379] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:14.980427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c8e9c10-3304-4748-a4d2-68dc21f50bac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105357 Jul 11 15:58:14.981012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 691/1380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:15.575748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:15.576723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:15.577306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:15.578250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:15.580185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:15.588006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:15.588495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:15.588904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:15.589260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:15.589434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:15.589695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:15.590104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:15.590521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:15.619788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e78dd99-23bf-485f-9d4f-597411acc4b5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Jul 11 15:58:15.620233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-664e4a2e-4d02-4f5f-a23c-707da1dc6b85 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050027 Jul 11 15:58:15.620478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 690/1381] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:15.620832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 692/1382] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:15.988098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:15.989497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:16.000616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.001022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:16.001315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.002169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:16.002561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.003236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.010739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.011209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.012005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.012493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.036613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-648a1752-8ff8-4c25-a3ad-b71171d7627e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054626 Jul 11 15:58:16.037300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 691/1383] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:16.073897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:16.081568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7d16df0-a822-491d-9bc3-6a96a556ff41 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086545 Jul 11 15:58:16.082453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 693/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:16.634695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:16.635388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:16.635751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:16.636113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:16.642502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.642674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.642944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.643088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.643704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.643863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:16.644158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.644337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:16.674785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5194192c-a402-4bed-95de-5572ec9774e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045816 Jul 11 15:58:16.675012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c94bd5cc-e503-4803-8ebc-2b0ffe0a9905 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046200 Jul 11 15:58:16.675406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 692/1385] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:16.675791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 694/1386] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:16.790312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:58:16.790640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 15:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:58:17.052589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:17.054086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:17.061404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.061851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.062640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.063071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.092874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e48ffc68-c117-43a1-8794-c8a003869ee3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Jul 11 15:58:17.093426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 693/1387] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:17.099147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:17.099758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:17.106243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.106694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.107454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.107891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.179695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:17.188949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-db80e830-1725-4f60-b7ed-463f2dbc3aa2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093582 Jul 11 15:58:17.189516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 695/1388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:17.690973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:17.692048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:17.692739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:17.692908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:17.703549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.703883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.704338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.704741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.705613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.705894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:17.706303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.706489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:17.712993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:17.739484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-770bbd6f-4572-46b4-b152-bb398807af2d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055075 Jul 11 15:58:17.739775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fa3d3319-3526-4e78-bdea-885a582a700a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055098 Jul 11 15:58:17.740310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 696/1390] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:58:17.740459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 694/1390] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:58:18.109021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:18.110498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:18.120735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.121481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.122701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.123436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.157149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fe82b114-eeaa-49e1-8ba0-96866f563296 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054911 Jul 11 15:58:18.157701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 697/1391] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:18.206869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:18.207728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:18.214395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.214852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.215605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.216038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.285912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:18.294094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e35f2cbc-df8e-4048-85dc-450165d85247 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091284 Jul 11 15:58:18.294659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 695/1392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:18.754052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:18.754616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:18.754983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:18.755086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:18.762401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.762935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.763088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.763388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.763717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.764146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.764322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:18.764683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:18.794344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f310ace3-c547-49ac-933b-4c3522ca2936 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046690 Jul 11 15:58:18.794650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c1fc417-4935-4454-ba78-f5377d132d9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Jul 11 15:58:18.798421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 698/1394] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:18.798570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 696/1394] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:19.174462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:19.175949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:19.184059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.184534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.185276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.185727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.217639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7124c66e-a647-4ee2-b530-ea5f5633d08f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050658 Jul 11 15:58:19.218191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 699/1395] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:19.314738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:19.315659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:19.326016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.326697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.327848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.328547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.395359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:19.403243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0be18e9-86b6-453d-b2d2-3ca9b461ac89 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094537 Jul 11 15:58:19.403806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 697/1396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:19.810468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:19.811579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:19.812180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:19.812737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:19.819045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.819501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.819692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.820166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.820359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.820865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.822247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:19.822685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:19.851490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab1e5c9d-cd1f-4206-bfeb-400acf8ac88e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047829 Jul 11 15:58:19.852055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 698/1397] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:19.854089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-92b825a6-5ec8-4441-a3ba-74df3c6ecf18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050485 Jul 11 15:58:19.854981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 700/1398] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:20.229760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:20.230698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:20.239578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.240233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.241469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.241994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.276896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b3e0554-1430-4f4e-9585-b347b64cef37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051184 Jul 11 15:58:20.277448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 699/1399] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:20.424177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:20.425231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:20.436497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.437269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.438496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.439221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.507513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:20.516025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-81deb073-2e6f-4372-ba16-1cb8178f05c1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098351 Jul 11 15:58:20.516637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 701/1400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:20.867716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:20.868647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:20.869100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:20.869594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:20.875842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.876315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.876480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.876874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.877087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.877532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.877709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:20.878032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:20.907670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-08b5f88e-c718-4589-919d-36e3c47df0bc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046754 Jul 11 15:58:20.908162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c11c5903-c86d-49d2-bd20-b1da9e12a8bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Jul 11 15:58:20.908282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 700/1401] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:20.908751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 702/1402] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:21.292980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:21.294107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:21.301868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.302425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.303397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.303936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.335031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dbb22323-0c0d-4da4-9a54-f838b269855d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Jul 11 15:58:21.335584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 701/1403] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:21.536455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:21.537376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:21.548014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.548814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.550087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.550820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.625092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:21.633810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15057148-a943-4dee-8429-4ce118bf2bd7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103345 Jul 11 15:58:21.634386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 703/1404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:21.920819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:21.921431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:21.921809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:21.921918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:21.928717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.928892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.929160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.929318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.929970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.930117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:21.930408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.930705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:21.959884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d14fe0b3-7338-4724-a7ea-654f41993bb0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Jul 11 15:58:21.960667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 704/1405] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:21.960800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4bf292e4-16d4-4980-9ba3-aa076bb99fd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043765 Jul 11 15:58:21.961880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 702/1406] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:22.347861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:22.348801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:22.355783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.356230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.357013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.357441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.398275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29857ed8-9df9-4d89-ad32-b243eb9b02c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054160 Jul 11 15:58:22.399262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 705/1407] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:22.654727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:22.655746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:22.665620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.666063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.666816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.667242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.739075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:22.750020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff3294c1-9959-4910-9dc4-503a0e4011f1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101531 Jul 11 15:58:22.750813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 703/1408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:22.975925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:22.976903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:22.977876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:22.978107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:22.988780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.989111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.989528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.989795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.990785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.991024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:22.991491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:22.991717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:23.022511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a94f505f-baf8-4394-b2c0-670d8dda88f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053225 Jul 11 15:58:23.023015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6501b445-0194-4142-86e3-19647d21d6b6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053588 Jul 11 15:58:23.023179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 706/1409] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:58:23.023804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 704/1410] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:23.412480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:23.413440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:23.420254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:23.420730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:23.421488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:23.421925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:23.452318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0657cf2b-5e75-4b8b-a1ff-c7e411784cee tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 11 15:58:23.452872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 707/1411] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:23.775279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:23.775843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:23.782961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:23.783536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:23.784687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:23.785280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:23.810987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:23.860765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:23.870187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b017b3d8-da99-4f50-ae1a-b4acdb570bf9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102757 Jul 11 15:58:23.871066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 705/1412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:24.035727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:24.036246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:24.036748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:24.036885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:24.044004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.044491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.044632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.045074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.045232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.045780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.045932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.046257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.076852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e3334b9-dbd6-4fb7-b312-154a0323c02f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Jul 11 15:58:24.077729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 708/1413] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:24.078300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc5829c7-1241-4128-a420-ff6045968a98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046505 Jul 11 15:58:24.079384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 706/1414] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:24.466038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:24.467048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:24.474171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.474670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.475505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.475981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.507719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96860681-f31d-422e-b6f3-f6f8d3880edd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Jul 11 15:58:24.508329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 709/1415] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:24.889999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:24.890705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:24.898224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.898855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.899763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:24.900269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:24.964501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:24.972149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e86e0c4-520b-4c17-aa46-ca2a9c4fc011 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087486 Jul 11 15:58:24.972751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 707/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:25.094531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:25.095674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:25.096409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:25.097162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:25.105346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.105563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.105791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.105955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.106576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.106724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.106999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.107165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.136920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c8e67bfe-6f00-45f4-8cff-5a36042b2ea2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048968 Jul 11 15:58:25.137478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 708/1417] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:58:25.137639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-76e061da-74f3-400e-a738-c931ae18ae9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050755 Jul 11 15:58:25.138101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 710/1418] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:25.524596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:25.525910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:25.536024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.536806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.538040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:25.538739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:25.568684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b23dbf7-8f73-4da1-b8bb-eb5db062be52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051276 Jul 11 15:58:25.569238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 709/1419] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:25.994051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:25.994714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:26.002843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.003661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.005069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.005574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.069500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:26.081897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0c83deef-1698-4e8b-a7ef-279212fdee32 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091793 Jul 11 15:58:26.083045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 711/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:26.148024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:26.148740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:26.149103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:26.149201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:26.155853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.156321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.156783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.157091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.157361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.157523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.158127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.158680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.183760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:26.189687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58764146-80fb-42bd-8514-401e9e8eedfe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045508 Jul 11 15:58:26.190624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 710/1421] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:26.196073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aac866cc-0f72-4c44-9dfd-48e5c4d3f6a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051732 Jul 11 15:58:26.196727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 712/1422] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:26.580996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:26.581974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:26.588900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.589349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.590111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:26.590548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:26.619687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70ced7cc-22d7-4445-9506-cdb31e95daab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Jul 11 15:58:26.620333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 711/1423] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:27.105394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:27.106212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:27.114631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.115234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.116241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.116884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.186221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:27.194283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1c8802e8-b88f-4152-8809-ab76153beba1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095210 Jul 11 15:58:27.195137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 713/1424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:27.201700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:27.202728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:27.208407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:27.209347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:27.210111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.210568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.211479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.211921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.215670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.216145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.216924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.217355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.241614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d87c7ce4-5370-4f84-b02d-aecbf32c2772 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043976 Jul 11 15:58:27.242162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 712/1425] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:27.247232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-65c2965b-fdc0-4f05-9f95-b82d73e1447e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Jul 11 15:58:27.247794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 714/1426] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:27.635067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:27.636487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:27.646204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.646877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.648021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:27.648729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:27.678084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7e04991c-638a-47eb-8109-fd13d0d60bc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Jul 11 15:58:27.678636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 713/1427] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:28.211281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:28.212414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:28.219046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.219499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.220255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.220715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.253362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:28.254427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:28.263323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.263982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.265123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.265657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.290912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:28.297347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d347611e-b904-4b4d-9a58-f23de547cf98 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047817 Jul 11 15:58:28.298141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 714/1428] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:28.298769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef481f3f-de5c-4dff-9f46-a575da8ea5e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091851 Jul 11 15:58:28.300010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 715/1429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:28.304350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:28.305336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:28.311879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.312318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.313119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.313552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.345912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f45fc633-2ea9-4b47-8cbb-68d00c6eff0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Jul 11 15:58:28.346609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 715/1430] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:28.694656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:28.696304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:28.702735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.703178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.703961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:28.704428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:28.735683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b92cb01f-0822-47a5-800b-6ae0aeae5643 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047808 Jul 11 15:58:28.736220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 716/1431] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:29.314779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:29.316261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:29.318692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:29.319789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:29.322869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:29.325119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.325719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.326797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.327301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.328157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.328638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.329400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.329837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.362067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0f9b9d3-8ddf-45aa-975c-17828163acd7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054514 Jul 11 15:58:29.362824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 716/1432] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:29.367553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:29.368656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:29.375168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.375617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.376405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.376834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.392540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:29.401429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b572e42-b4f0-4c4e-8d5d-73a109df8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089130 Jul 11 15:58:29.402216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 717/1433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:29.412390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c3b149c-7ad3-4d19-8a10-b56fe5f3a931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048568 Jul 11 15:58:29.413350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 717/1434] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:29.748600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:29.749443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:29.755863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.756319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.757116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:29.757550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:29.788189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e64be7f6-c5de-4af8-b16e-c43c4af87408 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Jul 11 15:58:29.788767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 718/1435] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:30.376807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:30.379028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:30.389018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.389608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.390601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.391178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.417666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:30.418318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:30.423117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0033c3fb-8826-4754-a173-ee086b99bdf1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051803 Jul 11 15:58:30.423683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 718/1436] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:30.424672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.425129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.425899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.426306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.428632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:30.429526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:30.435762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.436231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.437025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.437454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.466554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7d3ed7e-5b97-4bf8-8d84-245467696afe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 Jul 11 15:58:30.467033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 719/1437] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:30.489800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:30.497963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ddabb45b-7e84-41d3-ab6f-f3cf60cee48b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084331 Jul 11 15:58:30.498527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 719/1438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:30.549809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:58:30.549997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 15:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:58:30.799724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:30.800688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:30.807324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.807771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.808616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:30.809050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:30.838554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-219610b0-83c1-474e-b610-5db495223ac8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Jul 11 15:58:30.839107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 720/1439] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:31.440051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:31.441647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:31.453042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.453692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.455003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.455726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.477596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:31.478626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:31.485403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.485927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.486675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.487098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.490681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26534f7f-4e8d-487d-af96-aedac541d340 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057514 Jul 11 15:58:31.491270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 720/1440] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:31.514941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:31.515579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:31.517513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d0d85426-6614-4699-90be-cb1732ddb9bf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Jul 11 15:58:31.518365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 721/1441] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:31.523968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.524448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.525698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.526345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.600760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:31.609087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a958bbf-ec5a-4547-a63b-a7b2f7fda1ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097970 Jul 11 15:58:31.609650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 721/1442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:58:31.854040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:31.855016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:31.863992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.864657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.865837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:31.866421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:31.870739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:31.898423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca37351c-2500-4102-8bf8-058d056b5910 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050448 Jul 11 15:58:31.899400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 722/1443] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:32.505132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:32.506121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:32.513619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.514064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.514821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.515252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.529406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:32.530298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:32.538784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.539242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.540278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.540905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.548885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ee495611-542c-4fc9-97cb-0c05a61fbca8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048779 Jul 11 15:58:32.549812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 722/1444] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:32.569708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-13c080e3-f70d-4acc-b0ca-a59ac15215c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jul 11 15:58:32.570262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 723/1445] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:32.630823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:32.631918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:32.642716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.643711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.644990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.645710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.710965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:32.719940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e7b364d-37ca-4cde-9806-38f6478d8d65 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096426 Jul 11 15:58:32.720552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 723/1446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:32.918899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:32.920952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:32.931403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.931882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.932691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:32.933122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:32.964980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30107e91-ac98-4d0f-bf2b-87cdebd5273f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056105 Jul 11 15:58:32.965559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 724/1447] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:33.561744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:33.563022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:33.569987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.570437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.571189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.571617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.581553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:33.582784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:33.589809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.590248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.591004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.591425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.605034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31b8c339-c20d-4007-8bba-52f9d18b1086 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047576 Jul 11 15:58:33.605826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 724/1448] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:33.622319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1cbeed43-44e3-4f7e-88f6-f336fa319c31 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Jul 11 15:58:33.622869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 725/1449] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:33.740958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:33.741960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:33.751071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.751524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.752282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.752755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.831383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:33.839843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c4530ed-3d4e-4359-9ee9-211eeb633861 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105338 Jul 11 15:58:33.840461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 725/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:33.979584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:33.980609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:33.987262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.987729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:33.988551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:33.988983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.022612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b55ec11d-42cd-4d9b-a68f-ff63f52d2dfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048514 Jul 11 15:58:34.023157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 726/1451] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:34.622930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:34.624454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:34.635192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.635642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.636442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.636880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.637094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:34.638273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:34.644984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.645422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.646176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.646599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.668203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a7be394-df1a-42d1-8c1b-dd74bf7be685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052797 Jul 11 15:58:34.669017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 726/1452] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:34.676206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70576c86-bdca-40ed-85b6-fe8ca6971cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Jul 11 15:58:34.676808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 727/1453] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:34.859355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:34.860116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:34.868783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.869231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.869994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:34.870430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:34.944664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:34.956766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-014c123e-40fb-47a2-b9d7-dc08276ee536 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103200 Jul 11 15:58:34.957726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 727/1454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:35.036544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:35.037738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:35.046414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.047014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.048008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.048632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.089957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06e288ae-1758-4454-a0f1-a749555d4245 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058750 Jul 11 15:58:35.090516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 728/1455] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:35.681409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:35.682421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:35.687648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:35.688628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:35.689457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.689903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.690663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.691078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.695419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.695868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.696694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.697152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.720883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-53a72fe4-c9c1-4b1f-9e60-c5e35e4cbc40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043840 Jul 11 15:58:35.721435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 728/1456] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:35.727068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d464150d-24bf-4f30-9f48-10d817c8f81f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Jul 11 15:58:35.727647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 729/1457] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:35.974764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:35.975376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:35.982188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.982619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:35.983378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:35.983809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.003173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:36.050235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:36.058550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0479537e-64bb-4c3c-a591-256147071ba6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087835 Jul 11 15:58:36.059124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 729/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:36.101844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:36.102800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:36.109480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.109933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.110686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.111117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.141088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c242a70e-fac7-4aa2-873f-4f68bdb972b5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Jul 11 15:58:36.141643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 730/1459] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:36.737230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:36.738755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:36.742981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:36.743888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:36.747296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.747749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.748552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.748977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.750475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.750920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.751662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:36.752219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:36.779291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-01d6c064-7c05-4060-a876-c5b6f8464ee6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048809 Jul 11 15:58:36.779863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 730/1460] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:36.782086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-38c32ce0-4e28-4169-a319-986962759047 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Jul 11 15:58:36.782644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 731/1461] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:37.080101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:37.081033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:37.091082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.091783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.093042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.093712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.153763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:37.155037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:37.158457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:37.162547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.163072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.163995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.164659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.165968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df50e6ec-69a4-4c5a-a5bc-04f473fb39ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092435 Jul 11 15:58:37.166529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 731/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:37.199528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a72985a8-ca33-4428-85eb-2bf3ca8bc411 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050780 Jul 11 15:58:37.200097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 732/1463] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:37.793557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:37.794479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:37.796487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:37.797405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:37.801462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.801954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.802850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.803161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.804044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.804559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.805330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:37.805778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:37.834239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-64d3a33e-3478-4657-b49c-e7b1e6765c69 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046074 Jul 11 15:58:37.834813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 732/1464] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:37.835186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6098285c-7dbc-424a-82ea-b1bf7f95fcfb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Jul 11 15:58:37.835737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 733/1465] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:38.194824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:38.196348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:38.208100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.208894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.210384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.211111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.214463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:38.215457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:38.221878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.222330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.223095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.223534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.253995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-125e0c9b-0b7b-4227-a831-359b56aae1c8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jul 11 15:58:38.254533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 734/1466] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:38.274971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:38.282686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2c26aea6-139d-486b-9e70-85cb8e79edee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097805 Jul 11 15:58:38.283242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 733/1467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:38.851898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:38.853551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:38.859265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:38.860342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:38.864836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.865576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.866831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.867692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.870935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.871380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.872147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:38.872617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:38.899491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-08c2f42c-4f78-4ff4-81ce-2c4c55089b7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054779 Jul 11 15:58:38.900159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 734/1468] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:38.903072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5ec401e7-e4eb-4a22-aa7b-2d31c1adb5a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058775 Jul 11 15:58:38.903612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 735/1469] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:39.268935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:39.269972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:39.279802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.280648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.281971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.282696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.299926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:39.300568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:39.306938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.307377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.308119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.308599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.318309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3aad7f94-ea80-497b-8e79-bdb23ef0e3cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055894 Jul 11 15:58:39.319129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 735/1470] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:39.376635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:39.388381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ca24afb-2568-4f62-b499-cd3c2d3138ec tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092233 Jul 11 15:58:39.389135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 736/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:39.916200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:39.917185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:39.918047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:39.919412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:39.924319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.924759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.925546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.925983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.926152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.926654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.927456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:39.927884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:39.958977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c737e777-9fb5-45e4-a3c2-27d4df29a27d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049991 Jul 11 15:58:39.959538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 736/1472] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:39.959981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-717fca32-1f9c-4041-a411-d5faedae6eb2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Jul 11 15:58:39.960657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 737/1473] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:40.335334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:40.337076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:40.343564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.344012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.344798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.345230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.374769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37b4a69e-27f7-4e47-9d34-5d36a7bb1db0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046579 Jul 11 15:58:40.375310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 737/1474] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:40.409349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:40.409963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:40.416091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.416583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.417336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.417771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.482976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:40.488346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:40.495978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc60c68e-674c-4276-9204-3707e497123b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090204 Jul 11 15:58:40.496684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 738/1475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:40.975749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:40.976670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:40.977982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:40.978324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:40.989295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.989576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.990042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.990296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.991334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.991559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:40.992052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:40.992276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:41.022615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57ea12c1-cb7d-4bc4-9531-9b2ccb6aeb7c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053376 Jul 11 15:58:41.022902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0136688f-26a8-4c3b-a432-7ea1f5bf2045 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053933 Jul 11 15:58:41.023185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 739/1476] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:41.023500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 738/1477] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:41.391025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:41.392509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:41.394874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:41.402162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:41.402798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:41.403855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:41.404547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:41.438427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-03f3de09-d981-49b0-8d2b-c34e980bc85f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054413 Jul 11 15:58:41.438968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 740/1478] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:58:41.524671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:41.526542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:41.541855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:41.542442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:41.543214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:41.543655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:41.607127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:41.614951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3ede6d3b-8a1d-40eb-afd6-0739a708253c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099325 Jul 11 15:58:41.615523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 739/1479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:42.037866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:42.038674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:42.039287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:42.040184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:42.046594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.046961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.047133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.047409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.047793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.048169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.048328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.048615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.078048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-02d2ab65-ac28-40ce-8f80-813dee8ecf10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Jul 11 15:58:42.081827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 741/1480] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:42.081977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26b54026-5d8e-400a-bb23-48f07b161d61 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Jul 11 15:58:42.081977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 740/1481] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:42.450617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:42.451465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:42.458277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.458727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.459486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.459919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.490754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dbeff0b3-48e9-4e34-8302-f1a63aadb538 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Jul 11 15:58:42.491299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 742/1482] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:42.635552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:42.636590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:42.646739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.647445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.648744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:42.649568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:42.711014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:42.725401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-58b3c49c-c998-4518-9330-07b89d8576fa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095875 Jul 11 15:58:42.726218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 741/1483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:43.094239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:43.095122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:43.096132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:43.096612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:43.105562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.105922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.106063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.106339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.106761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.107171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.107315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.107610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.136800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-363bf88d-c178-40b3-8b1f-472294abeca0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048401 Jul 11 15:58:43.137079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5ab2644f-ec69-4096-aaae-b3e7a1b1dcdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049616 Jul 11 15:58:43.137910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 742/1484] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:43.138141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 743/1485] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:43.504669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:43.505836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:43.513204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.513657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.514418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.514842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.546026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fa683ea1-c06d-4920-b8ce-964d48b0be5d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Jul 11 15:58:43.546568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 743/1486] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:43.747138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:43.748165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:43.758455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.759997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.760878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:43.761305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:43.826662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:43.835991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29807c44-ba55-479f-a4e3-fedc002cdd1d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095035 Jul 11 15:58:43.836925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 744/1487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:44.149003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:44.149823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:44.150206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:44.150662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:44.157214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.157557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.157668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.158002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.158411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.158784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.158887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.159209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.189107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6321e01b-ea49-49fa-8431-36249519672e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Jul 11 15:58:44.189926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 744/1488] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:44.192807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f45f8af4-a54e-4882-a094-b58b0b9f47a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047780 Jul 11 15:58:44.193440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 745/1489] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:44.562035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:44.563541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:44.572946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.573398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.574162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.574598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.604672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1c24360-360e-4a33-b7a6-38d19ed4891a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Jul 11 15:58:44.605231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 745/1490] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:44.858591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:44.859412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:44.869214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.869652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.870426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:44.870917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:44.942729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:44.950575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a52b4691-091a-4566-a4b9-36beffe08317 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098676 Jul 11 15:58:44.951227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 746/1491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:45.202041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:45.202969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:45.204530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:45.205524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:45.209924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.210378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.211136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.211589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.213037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.213490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.214258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.214715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.215539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:45.241822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83f7b26e-bb8a-4df3-a43d-5ad7462d8367 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Jul 11 15:58:45.242424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 746/1492] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:45.244323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f5e4d196-829a-49bc-ade4-a566bf8d41dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Jul 11 15:58:45.244885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 747/1493] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:45.619433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:45.620347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:45.626817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.627262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.628009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.628478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.658461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dfd07255-ecab-4b68-945c-4cdc50dceb53 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Jul 11 15:58:45.659002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 747/1494] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:45.974437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:45.975425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:45.983144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.983611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:45.984397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:45.984816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.048026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:46.056793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-da543b68-d881-41a6-b07a-f171652c2fa9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088866 Jul 11 15:58:46.057332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 748/1495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:46.253846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:46.254668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:46.256657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:46.257822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:46.263101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.263839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.264883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.265056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.265354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.265637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.266101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.266552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.296846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-46f34087-2b68-48f7-ba01-19b5d02ea17a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044743 Jul 11 15:58:46.297622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 749/1496] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:46.298994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-47ddf0e6-1b44-4f01-ab34-6da1c75ea90a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049385 Jul 11 15:58:46.302598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 748/1497] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:46.670439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:46.671463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:46.677741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.678273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.679033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:46.679468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:46.708985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-173876a3-3a4d-4f78-8c8a-7146cf2cc81a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Jul 11 15:58:46.709533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 750/1498] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:47.078310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:47.079314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:47.089027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.089469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.090225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.090653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.152193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:47.160418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-33dca9a2-6192-4d3e-9fb4-c0ba2e391c64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089489 Jul 11 15:58:47.160984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 749/1499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:47.313357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:47.314590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:47.315340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:47.316189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:47.324643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.324842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.325097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.325218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.325857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.325970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.326290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.326413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.356078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0dfacb86-b8fc-4842-9e1d-0609fd977374 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Jul 11 15:58:47.356478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66bd844a-0e70-45cc-ba7d-9f8ed2cfb746 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050741 Jul 11 15:58:47.356642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 750/1500] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:47.357047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 751/1501] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:47.725275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:47.726660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:47.736916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.737728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.739003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:47.739733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:47.771265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-351766ee-70b2-4237-bb12-c1b23839437c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052927 Jul 11 15:58:47.771823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 751/1502] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:48.181588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:48.182419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:48.189212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.189655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.190427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.191019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.253867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:48.261799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78366753-f549-4f2b-820b-1c0abab91f17 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086490 Jul 11 15:58:48.262369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 752/1503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:48.370399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:48.370988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:48.371373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:48.371887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:48.378411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.378887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.379362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.379663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.379977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.380092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.380889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.381316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.410007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f62a37ea-ecbe-4952-9bd7-a031eb35658d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Jul 11 15:58:48.410283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf6413b9-6b55-4ae7-a242-5f4a42a97b64 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044505 Jul 11 15:58:48.410576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 752/1504] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:48.411458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 753/1505] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:48.788161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:48.789703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:48.796662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.797106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.797861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:48.798286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:48.828203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54d8ba29-5a6d-415c-8b7f-cfde8b0c9954 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046646 Jul 11 15:58:48.828776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 753/1506] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:49.279922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:49.280678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:49.287373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.287814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.288603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.289032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.354482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:49.362150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c5d269b-1d6a-4574-9035-5debda860496 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086908 Jul 11 15:58:49.362787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 754/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:49.421829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:49.422492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:49.422869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:49.423312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:49.429433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.429902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.430771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.431228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.431566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.432009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.432836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.433239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.448531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:49.462890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30bc6d57-a6f3-423f-8d8e-48c30c9d22a0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044910 Jul 11 15:58:49.463674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 755/1508] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:49.463808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ed1fb86-203d-420c-a101-d891b268b2f4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Jul 11 15:58:49.467397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 754/1509] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:49.844539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:49.846015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:49.854753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.855196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.855946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:49.856411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:49.885751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b7a01e6-1420-474b-8eff-3d2268bef698 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 Jul 11 15:58:49.886300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 756/1510] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:50.383695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:50.384327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:50.391448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.391965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.392828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.393279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.462005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:50.469706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3ca4926-9a37-4e98-a593-e026125cd328 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092966 Jul 11 15:58:50.470290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 755/1511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:50.475076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:50.475760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:50.476210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:50.476797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:50.482757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.483203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.483716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.483968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.484168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.484489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.484968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.485400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.515675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a6086cd-9da8-400d-bc64-1d5bf59db4f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044508 Jul 11 15:58:50.515932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8dcecc7b-4e87-4fcc-b003-000860a4bc9e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Jul 11 15:58:50.516489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 757/1512] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:50.516636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 756/1513] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:50.901261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:50.902251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:50.909341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.909836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.910663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:50.911137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:50.942696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf3d6051-2dc2-4a03-8479-2b3863ce06b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Jul 11 15:58:50.943234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 758/1514] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:51.490782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:51.491733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:51.499277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.499735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.500548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.500987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.527318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:51.528252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:51.535205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.535675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.536815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.537243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.564678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:51.567436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-089ee4c3-7190-44bc-8805-a0a488326bab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Jul 11 15:58:51.568001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 759/1515] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:51.573067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:51.573950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-60bfa637-07c8-4c22-a91c-feebe921ed6c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089861 Jul 11 15:58:51.574073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:51.574524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 757/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:51.579847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.580318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.581132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.581562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.610827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a5ce19ef-339d-40d2-9418-d6039d1266d0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041734 Jul 11 15:58:51.611361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 760/1517] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:51.958952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:51.960546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:51.970796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.971558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:51.972869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:51.973606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.004597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d3b5c512-7c6a-4fe4-8fe2-669359f039ea tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052624 Jul 11 15:58:52.005156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 758/1518] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:52.581063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:52.582585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:52.591425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:52.592002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.592119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.592960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.593536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.593702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:52.601912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.602766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.604421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.604880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.627272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a8198f45-3053-4786-a3a5-238ec93c7a45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051458 Jul 11 15:58:52.627886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 761/1519] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:52.636335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:52.637273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:52.644340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.645116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.646201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:52.646632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:52.671435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:52.678157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7b517577-cb7d-416b-9ff2-7c484877da54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049209 Jul 11 15:58:52.678708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 762/1520] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:52.679305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1947a5b2-b53b-41ca-8acf-744a802bd727 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091827 Jul 11 15:58:52.679871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 759/1521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:53.018236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:53.019729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:53.029931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.030770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.031609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.032039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.075971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a78593ac-b8eb-43b3-b018-1e396005bb48 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060636 Jul 11 15:58:53.076884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 763/1522] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:53.642613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:53.644066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:53.657665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.658412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.659589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.660207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.689582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15209c2e-1093-4ed6-9def-e65ccad03fd1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053608 Jul 11 15:58:53.690120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 760/1523] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:53.691439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:53.692857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:53.697954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:53.698559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:53.699603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.700068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.700872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.701312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.704642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.705074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.705828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:53.706259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:53.731508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4dc53d1a-8fda-464f-851c-9ada7fcaf322 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 Jul 11 15:58:53.732079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 764/1524] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:53.770366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:53.778561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0f0602d9-122a-4f44-bf47-eb12782151fe tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084538 Jul 11 15:58:53.779195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 761/1525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:54.091158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:54.092320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:54.099199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.099671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.100479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.100897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.130539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-68e41002-3324-4564-8ebf-41a1e80fa659 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Jul 11 15:58:54.131092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 765/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:54.706397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:54.708923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:54.717582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.718031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.718791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.719227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.744824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:54.745743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:54.746289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:54.751133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26d694e8-4014-4608-80d1-3862a55dd83b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051571 Jul 11 15:58:54.751702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 762/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:54.752532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.752949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.753712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.754148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.790929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-031ec7b1-7b1a-48c0-a068-bb4b7b4b47bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050678 Jul 11 15:58:54.791510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 766/1528] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:54.796481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:54.797382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:54.808414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.809028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.810085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:54.810732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:54.877616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:54.885548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cfab8441-1c37-4c65-bada-bfb784e56f73 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093699 Jul 11 15:58:54.886111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 763/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:55.146794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:55.148382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:55.155673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.156123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.156911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.157343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.191207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5eb1270a-0719-43d4-8f1d-fe50066eaa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050661 Jul 11 15:58:55.192167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 767/1530] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:55.767848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:55.769447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:55.780564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.781302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.782539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.783252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.802185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:55.803131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:55.809945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.810397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.811158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.811595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.816139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3b572152-ad46-428e-98f6-eb2f57f9bdae tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055221 Jul 11 15:58:55.816745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 764/1531] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:55.843705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c28b4384-323b-4e0a-83ed-3ba77800d195 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Jul 11 15:58:55.844227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 768/1532] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:55.903021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:55.903742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:55.911670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.912190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.913223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:55.913749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:55.978689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:55.986692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6676bef4-9765-43c0-845f-34bbd7312b47 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088613 Jul 11 15:58:55.987299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 765/1533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:56.207764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:56.209305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:56.217227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.217673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.218428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.218860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.248155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-851cb214-9ac6-4a3b-ae30-36723247a1a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047572 Jul 11 15:58:56.248735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 769/1534] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:56.831851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:56.833749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:56.842027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.842484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.843255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.843687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.858198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:56.859108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:56.865859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.866305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.867055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:56.867515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:56.873563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c06878e-3168-4fec-8f63-19e0c7993407 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048254 Jul 11 15:58:56.874147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 766/1535] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:56.896922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8329f5ed-7929-49e9-aa00-6ffecc342879 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042858 Jul 11 15:58:56.897451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 770/1536] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:57.007093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:57.008082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:57.010416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:57.015942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.016413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.017170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.017599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.086033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:57.093822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7973eb61-9c9c-40c0-a195-a796ad8a0d5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093275 Jul 11 15:58:57.094383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 767/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:57.261382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:57.262314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:57.268815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.269263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.270045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.270481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.304866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a7efe27-e1e0-4a01-9d01-0407ccbb79dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Jul 11 15:58:57.305412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 771/1538] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:57.889965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:57.891535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:57.902612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.903340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.904734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.905454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.912930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:57.914658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:57.921595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.922035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.922785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:57.923209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:57.926949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:57.939971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-197501ce-ff47-43bc-8de9-1bcf670a42a0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056816 Jul 11 15:58:57.940589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 768/1539] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:57.954512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd792626-7d0b-4149-9574-b01034470934 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048165 Jul 11 15:58:57.955072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 772/1540] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:58.113779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:58.114879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:58.122670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.123129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.123889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.124325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.189219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:58.197262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ba95d5b-b425-4918-89c8-d32ad95a4418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089961 Jul 11 15:58:58.197840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 769/1541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:58.320281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:58.322301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:58.333029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.333781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.335124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.335844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.365691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ee06d809-8325-44bd-98d1-77367008079e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051950 Jul 11 15:58:58.366159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 773/1542] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:58.952062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:58.953033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:58.960217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.960760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.961578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.962004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.967410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:58.968312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:58.975188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.975640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.976413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:58.976837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:58.991781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-336163c5-794d-4691-a3c2-f070d9c920e3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Jul 11 15:58:58.992337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 770/1543] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:58:59.006946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00caf85b-cfee-4336-bf8b-9d908230afb0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043681 Jul 11 15:58:59.007502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 774/1544] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:58:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:58:59.215192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:59.215735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:59.222386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:59.222840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:59.223655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:59.224093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:59.287684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:58:59.296211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fad0c6d1-3f32-409f-b8a0-eabc8f574f57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085458 Jul 11 15:58:59.296862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 771/1545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:58:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:58:59.381444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:58:59.382977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:58:59.390327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:59.390775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:59.391529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:58:59.391958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:58:59.424008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05a69cb5-9c02-414a-bce1-8e31fc93019d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049129 Jul 11 15:58:59.424595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 775/1546] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:00.003825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:00.004803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:00.012221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.012716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.013481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.013919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.019015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:00.019966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:00.027356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.027871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.028674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.029146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.044553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fccb461-8226-4755-b6ca-19dd298671ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Jul 11 15:59:00.048443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 772/1547] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:58:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:00.061239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ea57606-6f75-4198-9e51-624ebce97359 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Jul 11 15:59:00.061843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 776/1548] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:00.322097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:00.322762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:00.329874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.330375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.331210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.331717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.399265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:00.407408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b05d578-a3a6-4d64-a9c4-8e20cbdec46a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091495 Jul 11 15:59:00.407972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 773/1549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:00.438275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:00.439579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:00.448276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.448920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.450005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:00.450602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:00.482441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24b339a4-46f2-4830-bf49-ff08e1d7e36f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050298 Jul 11 15:59:00.482986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 777/1550] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:01.059811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:01.061340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:01.072074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.072557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.073321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.073756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.075411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:01.076338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:01.083594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.084042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.084917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.085355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.103788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2b45b55f-1186-4d95-8009-ffcc1d182ebe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050806 Jul 11 15:59:01.104671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 774/1551] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:01.115957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-109d3f82-502a-431b-92d6-3bb3877cf6b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044458 Jul 11 15:59:01.116556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 778/1552] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:01.428909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:01.429801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:01.437184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.437638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.438402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.438839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.494512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:01.495421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:01.501520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:01.501772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.502210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.502960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:01.503391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:01.509943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-be907a29-1399-482c-b7bc-e2d707403edb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087816 Jul 11 15:59:01.510520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 775/1553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:01.535258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4d9dc37e-c1d1-43d2-841a-74ba731cba2a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Jul 11 15:59:01.535834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 779/1554] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:02.118834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:02.119760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:02.126375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.126825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.127588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.128023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.128613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:02.129736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:02.136578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.137014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.137770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.138192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.158085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6db3f9a7-ae15-4d02-a225-b6a469202d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Jul 11 15:59:02.158862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 776/1555] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:02.169497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bcf8344e-2095-443d-9116-4d3790b7748f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044945 Jul 11 15:59:02.170053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 780/1556] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:02.530866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:02.531926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:02.542900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.543375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.544174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.544649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.550481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:02.551459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:02.558360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.558884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.559725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:02.560203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:02.589727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-89bb380f-bf3f-449f-a755-aa827c893f7b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Jul 11 15:59:02.590395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 781/1557] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:59:02.611243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:02.619041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1a125f6-362f-4059-8b4e-034aad6bc8ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094778 Jul 11 15:59:02.619602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 777/1558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:03.171636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:03.172980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:03.182427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.183014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.184006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.184193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:03.184936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.185352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:03.193728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.194366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.195378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.196400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.217795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-87bdbf0e-f90b-4659-a938-b721f3d3961d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051389 Jul 11 15:59:03.218357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 782/1559] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:03.228199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fcfec4da-5eb2-4adf-841e-ba069ad19795 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050289 Jul 11 15:59:03.228821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 778/1560] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:03.605745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:03.607240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:03.617526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.618414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.619378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.619796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.636882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:03.637492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:03.644319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.644742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.645497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:03.645931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:03.651109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f0b9a3c-5a02-4880-8c2c-c80d79bcf9a4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052042 Jul 11 15:59:03.651681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 783/1561] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:03.665438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:03.710790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:03.718503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8918409c-fed1-43ce-a82d-aebe82d92d1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085768 Jul 11 15:59:03.719061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 779/1562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:04.230558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:04.231440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:04.238159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.238716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.239270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:04.239687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.239858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.240210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:04.253190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.253708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.254541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.254980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.285429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef88d95d-6ff1-4f9d-b330-87cd8d380384 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059520 Jul 11 15:59:04.285993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 784/1563] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:04.286113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b284a800-faa4-4883-95f3-ce108a37695b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050885 Jul 11 15:59:04.286640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 780/1564] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:04.666772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:04.667851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:04.675609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.676565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.677442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.677951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.712353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7acb71f3-cf5f-4738-b2fb-9a0349020546 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051958 Jul 11 15:59:04.712931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 785/1565] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:04.737967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:04.738894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:04.748858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.749490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.750604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:04.751259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:04.826117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:04.834308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-470ce0c9-5fa1-40ab-917c-f830e65dbaf8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102663 Jul 11 15:59:04.834850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 781/1566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:05.301279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:05.302420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:05.303172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:05.303913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:05.313667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.314323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.314584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.315287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.315548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.316323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.316713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.317394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.347281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7591336e-a45b-4743-889f-3ec0c9674f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052535 Jul 11 15:59:05.347831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 786/1567] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:05.350419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2b94704-e8c6-4186-8709-9ef1734b9425 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054713 Jul 11 15:59:05.351189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 782/1568] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:05.727625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:05.729229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:05.739244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.739982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.741272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.741980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.772749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dcf59102-2d6c-4916-b60e-e97d16c7b367 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052074 Jul 11 15:59:05.773293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 787/1569] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:05.853719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:05.854751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:05.864339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.865004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.866071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:05.866679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:05.934716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:05.942625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a7547ef-dfd3-4d89-a3dd-942e9a81be68 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094423 Jul 11 15:59:05.943168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 783/1570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:06.363378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:06.364938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:06.367005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:06.368264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:06.372873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.373325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.374087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.374521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.374672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.375056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.375820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.376264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.399561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:06.404838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f3eaf1a-19b5-47ec-806a-70b45bf26995 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Jul 11 15:59:06.405407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 788/1571] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:06.406815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-522e4740-6f68-4520-b8b9-c6f827e6eab9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046453 Jul 11 15:59:06.407382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 784/1572] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:06.789585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:06.790559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:06.797298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.797772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.798563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.799013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.829219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-08061d24-996d-4c68-be93-faf578a5210f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Jul 11 15:59:06.829740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 789/1573] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:06.964107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:06.965163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:06.976177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.977046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:06.977822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:06.978259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.044583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:07.056906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4992d184-3753-478e-b473-d77b2fe16fc2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099413 Jul 11 15:59:07.057729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 785/1574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:07.421265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:07.422360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:07.423121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:07.424034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:07.426442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:07.432856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.433327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.433474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.433816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.434084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.434504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.434624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.434951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.465062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-03370934-aeef-4dc1-8d40-93b18d1ac79a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049245 Jul 11 15:59:07.465334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dce52f40-a89d-44d4-96e5-e723b4088759 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050603 Jul 11 15:59:07.465608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 786/1575] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:07.465820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 790/1576] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:07.847844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:07.849428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:07.857083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.857537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.858306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:07.858744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:07.889908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f94f022-507b-4f1d-8694-316708b7d069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048920 Jul 11 15:59:07.890469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 787/1577] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:08.083359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:08.084459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:08.091657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.092107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.093048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.093487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.162653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:08.170989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-616d9479-4dce-4176-8312-6d520d5ec16d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094496 Jul 11 15:59:08.171551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 791/1578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:08.480283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:08.480868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:08.481226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:08.481394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:08.487914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.488100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.488390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.488552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.489204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.489367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.489643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.489792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.518853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f8a37b1-f6d1-4db2-9bba-d0af20c83fc1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jul 11 15:59:08.519630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 792/1579] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:08.520507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5744a9c5-f6ae-4382-aa3d-0f7f1cc8b665 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046506 Jul 11 15:59:08.521041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 788/1580] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:08.906059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:08.907544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:08.917883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.918599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.919891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:08.921054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:08.954754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a74d1cec-b3bb-435e-9e98-0c9cf7992814 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055434 Jul 11 15:59:08.955302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 793/1581] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:09.188879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:09.189527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:09.197431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.198014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.198795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.199348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.271372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:09.281784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2d26b8b0-395c-4df7-a22b-6ca19d4a7e97 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097646 Jul 11 15:59:09.282543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 789/1582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:09.535214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:09.536058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:09.536873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:09.537555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:09.547961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.548251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.548756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.549022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.550011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.550251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.550703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.550944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.582624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1a8fdd61-f4b3-4f08-bc75-aac5e97afc88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053771 Jul 11 15:59:09.582882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-13a69136-c929-4461-ae97-3b37855ae8da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052883 Jul 11 15:59:09.583206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 794/1584] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:09.583358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 790/1584] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:09.969514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:09.970691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:09.979740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.980186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:09.980971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:09.981402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.012178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-38909cfe-96e1-4246-9525-afa071ebae52 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047490 Jul 11 15:59:10.012765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 795/1585] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:10.306124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:10.306882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:10.314779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.315339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.316281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.316864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.388683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:10.400318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-289b804b-9c30-4775-a248-fb02c1771c5f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100891 Jul 11 15:59:10.400917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 791/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:10.598706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:10.599688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:10.600337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:10.600516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:10.607549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.607816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.607990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.608259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.608761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.609057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:10.609202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.609484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:10.639243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cad83883-73c2-4839-86da-1de02fc869cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047221 Jul 11 15:59:10.639590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f2dccc55-4981-4c5a-b7bd-c05fdeb0a669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047597 Jul 11 15:59:10.644478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 796/1587] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:10.644640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 792/1588] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:11.027162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:11.027985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:11.034571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.035011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.035755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.036178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.065113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7c00ce9-5d1e-4ff3-b8f7-b406e62c34e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Jul 11 15:59:11.065660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 797/1589] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:11.419681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:11.420497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:11.428456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.429028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.430049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.430601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.506876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:11.515438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-03b4e118-127c-4779-b6e8-4879eadcb723 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101403 Jul 11 15:59:11.515985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 793/1590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:11.653561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:11.655332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:11.655917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:11.657192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:11.661742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.662194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.662949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.663506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.664507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.665243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.666205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:11.666855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:11.693849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e417b96-4167-4f2d-a915-8f38aabeffc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044818 Jul 11 15:59:11.694524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 798/1591] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:11.697638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f0b27068-5c16-4e8b-97d0-2d0733dd6f02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045929 Jul 11 15:59:11.698276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 794/1592] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:12.079278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:12.080545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:12.089757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.090349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.091334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.091903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.123947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c6a1032-6591-4e90-aec5-355d74cc4b06 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050031 Jul 11 15:59:12.124523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 799/1593] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:12.537265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:12.538325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:12.549547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.550305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.551624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.552394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.617482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:12.625276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-067c8016-c660-4490-a1c1-30659cc2a4c3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095331 Jul 11 15:59:12.625857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 795/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:12.705788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:12.706714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:12.709362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:12.710297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:12.713532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.713977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.714758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.715175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.716962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.717421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.718185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:12.718627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:12.722379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:12.744858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a6e6fca5-a227-4e98-b005-267fb8f126f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043025 Jul 11 15:59:12.745621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 800/1595] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:12.748773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7fb2888a-6a0a-410f-80f7-5a423d545bde tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jul 11 15:59:12.749347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 796/1596] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:13.135505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:13.136463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:13.143500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.143946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.144741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.145174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.180428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1111635e-3031-4744-8406-1242fda06904 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048984 Jul 11 15:59:13.180983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 801/1597] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:13.647124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:13.648185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:13.658635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.659394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.660709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.661432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.733460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:13.744480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd39c2c8-d25f-4c28-b785-5fdc51e19e63 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103616 Jul 11 15:59:13.745224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 797/1598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:13.756870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:13.757874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:13.760164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:13.761136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:13.764152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.764668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.765422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.765815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.767469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.767916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.768724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:13.769160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:13.795372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1471ef9-7690-4898-be0a-1a8e2386f6a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042450 Jul 11 15:59:13.796193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 802/1599] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:13.799530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-36f84802-dd73-4472-84f9-6cf5234e2ab8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Jul 11 15:59:13.800059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 798/1600] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:14.193380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:14.194593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:14.203460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.204056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.205118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.205690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.237328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a01c166f-bd14-4673-a380-1264c8f39ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049121 Jul 11 15:59:14.237691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 803/1601] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:14.767359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:14.768369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:14.777895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.778347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.779107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.779544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.807422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:14.808474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:14.814946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.815403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.816175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.816644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.848187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:14.854916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f41365d-2eaf-4812-bd08-84251d37ac23 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051485 Jul 11 15:59:14.855481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 804/1602] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:14.856144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5429b348-aeda-402d-bcfc-e39d06c205b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095676 Jul 11 15:59:14.859174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 799/1603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:14.860049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:14.861000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:14.866956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.867387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.868441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:14.869335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:14.885943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:14.898946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-51ac0ffd-4256-400a-9996-3e92661c81d9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Jul 11 15:59:14.899746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 805/1604] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:15.252621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:15.254113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:15.262905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.263352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.264113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.264579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.294850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b7bc07fa-5540-4578-aa53-2f677bdc66b3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Jul 11 15:59:15.295405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 800/1605] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:15.869419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:15.870542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:15.874323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:15.875103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:15.878802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.879371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.880401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.880948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.883426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.884087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.885005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.885453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.913259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7ae2c1b-54a2-47e7-bd51-419f63f21e3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049482 Jul 11 15:59:15.913839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 806/1606] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:15.919292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:15.920223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:15.926434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.926884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.927644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:15.928072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:15.953349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:15.959065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-699ab70b-aad1-41c1-a7da-4d837f5a027b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Jul 11 15:59:15.959836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 807/1607] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:15.961841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-51afff0f-5fde-4d30-881e-74cbc2e46281 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092422 Jul 11 15:59:15.962408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 801/1608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:16.308889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:16.309881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:16.316491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.316943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.317709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.318139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.348225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7305fa3-e2c8-4ec0-b949-21001a70ce03 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jul 11 15:59:16.348817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 808/1609] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:16.929634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:16.931124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:16.938228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.938661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.939416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.939844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.971142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:16.972079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:16.974808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1d782471-a336-4ce1-b7bf-a929e30d145a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051817 Jul 11 15:59:16.975601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 802/1610] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:16.979637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.980096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.980214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:16.980819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:16.980937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.981321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.987014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.987462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:16.988220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:16.988711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:17.011520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-087422ce-4b31-42fb-9a8e-ff390cdf7c64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Jul 11 15:59:17.012144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 809/1611] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 15:59:17.052519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:17.060595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80798b86-de60-49ab-86a3-df002a1d0f7a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083855 Jul 11 15:59:17.061164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 803/1612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:17.364734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:17.366271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:17.376760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:17.377190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:17.377951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:17.378414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:17.408038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-67181c95-0a4a-4a3a-97ca-2a8131f8a15f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050054 Jul 11 15:59:17.408639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 810/1613] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:17.991687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:17.993223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:18.003180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.003623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.004436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.004873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.023708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:18.024689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:18.031465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.031950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.032852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.033280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.034977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-636efe90-bfa0-460c-b613-4e1b0a74f2f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050656 Jul 11 15:59:18.035550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 804/1614] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:18.062816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c74bc86d-1262-4b22-8461-0af1001408d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Jul 11 15:59:18.063551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 811/1615] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:18.078422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:18.079153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:18.086115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.086563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.087315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.087749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.152819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:18.160799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ba6dfca-5a95-44a5-90da-8d3df151a245 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086376 Jul 11 15:59:18.161361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 805/1616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:18.424859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:18.425834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:18.432696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.433175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.433972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:18.434425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:18.472102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3897ae4b-9a01-422d-8ef2-c5844e7439c5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053294 Jul 11 15:59:18.472710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 812/1617] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:19.050803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:19.051706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:19.058845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.059297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.060112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.060550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.075194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:19.076404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:19.084242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.084724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.085496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.085933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.093855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4735bf58-88aa-4262-b952-9e27a636244d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048781 Jul 11 15:59:19.094467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 806/1618] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:19.116188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9f0144b0-d97c-4fcb-97c5-556c3eaa56fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Jul 11 15:59:19.116776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 813/1619] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:19.177864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:19.178485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:19.185188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.185635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.186441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.186869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.259266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:19.271809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a080e674-e315-4f46-a661-d63d960f710e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097736 Jul 11 15:59:19.272615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 807/1620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:19.488126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:19.489444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:19.499194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.499794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.501040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:19.501510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:19.532870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f394a01d-4e1b-4863-a939-a18bccad34cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050565 Jul 11 15:59:19.533416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 814/1621] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:20.106522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:20.107451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:20.116522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.116980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.117742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.118177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.129222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:20.130281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:20.137271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.137727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.138491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.138921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.149015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26b9af6c-459e-4d1a-89d8-6a8448a050b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046690 Jul 11 15:59:20.149591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 808/1622] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:20.167625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a92343a9-5657-4953-9291-6750396cd5fa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Jul 11 15:59:20.168177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 815/1623] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:20.291765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:20.292637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:20.302726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.303412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.304525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.305416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.377509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:20.385526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-075c7932-a781-471d-89a5-b1abc241b806 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099557 Jul 11 15:59:20.386095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 809/1624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:20.545088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:20.545936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:20.553038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.553494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.554254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:20.554691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:20.587203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-430022c9-57b1-4356-88ba-75f192fa5e6b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Jul 11 15:59:20.587756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 816/1625] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:21.164795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:21.166084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:21.176244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.176720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.177507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.177943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.180258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:21.181219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:21.188126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.188618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.189386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.189823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.210509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2a927e1b-924c-4867-b7ac-b0f19f1f559c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052432 Jul 11 15:59:21.211082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 810/1626] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:21.220889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-85927c84-3842-4353-a0a0-a4fd548b99cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Jul 11 15:59:21.221444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 817/1627] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:21.407583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:21.408700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:21.419285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.419945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.421318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.422075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.484846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:21.493564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3f453594-3740-4d36-bb56-ef1d0ebd2111 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092694 Jul 11 15:59:21.494349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 811/1628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:21.599899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:21.600906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:21.607601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.608048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.608849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:21.609271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:21.639795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32d23fde-044f-4f5b-8360-ac74d4dea80e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Jul 11 15:59:21.640375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 818/1629] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:22.222390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:22.223370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:22.230491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.230867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.231642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.232125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.232835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:22.233754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:22.241284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.241764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.242785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.243130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.259351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:22.264130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1041ec63-1259-467b-9f6d-1a10ec22ac3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046055 Jul 11 15:59:22.264759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 812/1630] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:22.275338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5c64850-4152-4777-8efa-dc7d53920526 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Jul 11 15:59:22.275912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 819/1631] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:22.514152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:22.514828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:22.524468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.525061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.526063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.526651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.595743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:22.603986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3118e80-b44d-46f3-ac13-7ae530180a6d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096736 Jul 11 15:59:22.604584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 813/1632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:22.651780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:22.652762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:22.660164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.660939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.662119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:22.662796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:22.697018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c767c35-0c6a-427f-b2d8-e42662ab3869 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049244 Jul 11 15:59:22.697571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 820/1633] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:23.277691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:23.278712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:23.286513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.286964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.287121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:23.287731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.288038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:23.288201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.294867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.295320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.296092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.296564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.326131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-572b34bf-1abc-4d37-8b3e-de1dfd386cff tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052790 Jul 11 15:59:23.326700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 814/1634] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:23.326846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f01bbbdc-fe6d-40c5-afb8-829a64221406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jul 11 15:59:23.327281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 821/1635] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:23.624816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:23.625824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:23.636665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.637420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.638690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.639423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.703403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:23.710264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:23.711177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:23.711787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5222adb4-c054-4ccd-8e9b-3890c4d03bb7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093553 Jul 11 15:59:23.712412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 815/1636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:23.717473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.717911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.718669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:23.719096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:23.722726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:23.748344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b95799fd-f4f0-4767-be0a-07187c525233 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042854 Jul 11 15:59:23.748919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 822/1637] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:24.338381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:24.338932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:24.339469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:24.340616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:24.346113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.346543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.347284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.347416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.347722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.347833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.348920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.349244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.381947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1af0772e-04a8-42ce-82b9-83d488197b9f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047603 Jul 11 15:59:24.382174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f0f6ae83-dc48-4d47-8694-777cc8fe64bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 Jul 11 15:59:24.382523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 823/1638] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:24.382912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 816/1639] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:59:24.729855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:24.730369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:24.736870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.737316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.738200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.738831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.760935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:24.761858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:24.763673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:24.769093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.769538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.770282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:24.770718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:24.801118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1c61d02-87c5-43da-8137-d2e6d4d356dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Jul 11 15:59:24.801834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 817/1640] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:24.808726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:24.816591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ee5f51c-a025-4865-8bcb-ed28d291d4b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091045 Jul 11 15:59:24.817150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 824/1641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:25.394266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:25.394864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:25.395249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:25.395364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:25.402069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.402372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.402510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.402863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.403264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.403585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.403683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.404025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.433818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-45fb807a-b125-4b06-b3a0-98e39116af5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jul 11 15:59:25.434236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a21f453-85c5-4365-9160-621b5549b67d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043786 Jul 11 15:59:25.434388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 818/1642] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:25.434782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 825/1643] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:25.817793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:25.819209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:25.829829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.830571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.832157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.833319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.836098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:25.836749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:25.843354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.843809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.844611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:25.845053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:25.864792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4bd08d58-3b4e-4674-b94b-e17ef4dc48d1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053922 Jul 11 15:59:25.865387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 819/1644] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:25.909000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:25.917195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ccc01ea-01db-43e9-80c0-d4231097603c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086170 Jul 11 15:59:25.917764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 826/1645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:26.450002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:26.450927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:26.451492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:26.451634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:26.461223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.461428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.461859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.462062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.462594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.462757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.463094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.463240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.494294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-538a7015-e562-41e9-a18e-c3295b69adf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051228 Jul 11 15:59:26.494787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de0d1bb3-5ea2-4922-940e-b8f941f7c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051360 Jul 11 15:59:26.494961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 827/1646] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:26.495531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 820/1647] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:26.878037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:26.879185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:26.886046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.886505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.887255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.887691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.918730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ccf0bf50-fcf4-4096-ae93-ad9093868db5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Jul 11 15:59:26.919305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 828/1648] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:26.943129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:26.943886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:26.950285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.950753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:26.951520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:26.951958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.019113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:27.032742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-adf93437-2705-4c3b-a286-7b05f4b94f7b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097251 Jul 11 15:59:27.033700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 821/1649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:27.509179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:27.509762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:27.510132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:27.510556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:27.517081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.517382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.517568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.517839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.518270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.518561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.518681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.519022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.549773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-534ffd25-3764-4cc1-8d62-466711b569e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046154 Jul 11 15:59:27.550215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2dcf4091-0dfe-4252-bcad-a40a8dcb3234 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045833 Jul 11 15:59:27.550666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 829/1650] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:27.551090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 822/1651] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:27.933086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:27.934214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:27.942144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.942697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.943642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:27.944196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:27.976551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77f91e7c-76d0-45c3-a157-76abdacce56f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Jul 11 15:59:27.977428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 830/1652] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:28.055054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:28.055735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:28.063066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.063582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.064512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.065016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.142771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:28.151111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4931b1e7-13f8-42b6-9d31-155b7dc774d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101056 Jul 11 15:59:28.151684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 823/1653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:28.564498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:28.565290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:28.565963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:28.566183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:28.575923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.576333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.576605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.576850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.577648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.577940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.578256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.578493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.609366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-82b1ec1b-2d11-4420-974e-ea00e56a7ad0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050599 Jul 11 15:59:28.609965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-50b78749-fdfc-4e7b-9874-7ded26d18ad2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050792 Jul 11 15:59:28.610558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 831/1654] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:28.610696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 824/1655] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:28.988695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:28.989613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:28.995958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.996430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:28.997185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:28.997609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.027806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7b6c7a8a-ac32-4227-bbd4-d49d5072b63b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Jul 11 15:59:29.028744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 832/1656] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:29.168511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:29.169124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:29.175710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.176156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.177455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.177895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.243894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:29.255545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9897c2ce-f79e-43a8-985f-16960de70d9c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091059 Jul 11 15:59:29.256114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 825/1657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:29.625689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:29.626756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:29.627339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:29.627485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:29.638278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.638823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.639083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.639575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.640266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.641020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:29.641291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.641749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:29.672797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06ff8563-01c0-4f70-8518-437470b758cf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053720 Jul 11 15:59:29.673568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-51b50715-f06f-4f6d-babd-d53581185a5e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054269 Jul 11 15:59:29.673722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 833/1658] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:29.674084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 826/1659] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:30.040281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:30.041268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:30.048450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.048925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.049709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.050194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.081417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b98fddf6-6552-4d53-a1e4-82e5dd245de7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Jul 11 15:59:30.082332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 834/1660] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:30.275558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:30.276271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:30.284717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.285321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.286931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.287516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.354621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:30.365848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52f68041-e92b-4601-8846-f022132ab5f0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096652 Jul 11 15:59:30.366425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 827/1661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:30.688708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:30.689628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:30.690221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:30.690558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:30.697715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.698265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.698426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.698939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.699092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.699454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.699705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:30.700140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:30.729971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-efadb193-90d1-4365-9eed-1900b48a7d0f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Jul 11 15:59:30.730541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 828/1662] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:30.731860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a0cd4be0-7103-4f6f-8036-dbbae1ed1452 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049020 Jul 11 15:59:30.732469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 835/1663] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:31.098783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:31.100260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:31.110603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.111354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.112699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.113431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.131629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:31.146200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2087ba76-9722-4b9e-a822-584e98437da2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054128 Jul 11 15:59:31.146792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 829/1664] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:31.387818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:31.388829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:31.399389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.400120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.401448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.402167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.473692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:31.481902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70d8c4d1-f5fe-40a8-841a-fb73b3eb2ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101322 Jul 11 15:59:31.482532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 836/1665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:31.744387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:31.744993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:31.745632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:31.745748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:31.752123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.752510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.752624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.752966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.753409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.753715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:31.753867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.754141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:31.783674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-594a48e1-3813-4a58-9492-851befda58da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Jul 11 15:59:31.784038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3efd7173-a1d1-4ebd-a880-e7e50470f037 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043801 Jul 11 15:59:31.784544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 830/1666] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:31.784681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 837/1667] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:32.162497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:32.163465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:32.170761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.171467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.172707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.173427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.207390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-35859835-f6d2-472b-ba5e-c6f49b3bf182 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051392 Jul 11 15:59:32.207963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 831/1668] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:32.509215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:32.510269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:32.520585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.521332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.522566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.523529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.589151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:32.592672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:32.597932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7699f7e-1725-4393-a6f5-09bf4630afe8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095726 Jul 11 15:59:32.598485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 838/1669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:32.797087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:32.797836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:32.798254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:32.798786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:32.806169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.806616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.806783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.807152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.807585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.808041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:32.808208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.808604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:32.840715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-97198ee8-af0e-4b99-9cd5-0ba8feec06b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Jul 11 15:59:32.841516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 839/1670] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:32.841855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f85b9502-83e4-465d-89ac-0393695fc5b0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049442 Jul 11 15:59:32.842432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 832/1671] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:59:33.219709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:33.220668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:33.222489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:33.228057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.228539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.229297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.229728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.259159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7b247faf-58c5-4b84-92cb-71a170bcb203 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Jul 11 15:59:33.259691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 840/1672] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:33.619974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:33.621095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:33.631281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.632046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.633701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.634144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.711701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:33.719418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4580b796-7423-4574-b14f-8d5caa274ec5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.106315 Jul 11 15:59:33.720274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 833/1673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:33.854495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:33.855173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:33.855684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:33.856284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:33.863979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.864200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.864564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.864740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.865565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.865742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:33.866094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.866262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:33.896667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4c00311-21cb-4bf9-9e80-bc9b71b60aa5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Jul 11 15:59:33.897035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8f50696-9e1d-4d59-8c82-ac8b734804bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046783 Jul 11 15:59:33.897197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 841/1674] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:33.897588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 834/1675] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:34.273429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:34.275229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:34.283747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.284363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.285379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.285947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.319813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5b455347-f913-41e6-bed7-f875fd952623 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051643 Jul 11 15:59:34.320796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 842/1676] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:34.740279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:34.741315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:34.752178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.752977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.754221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.754989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.820053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:34.828276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-821b52e0-90f1-49cb-86cb-07b2f3eb6b40 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094461 Jul 11 15:59:34.829019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 835/1677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:34.913790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:34.914803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:34.915490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:34.917354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:34.926800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.927542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.928793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.929090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.929537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.929769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.931374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:34.931815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:34.960386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9f45645-ce32-4c3f-96df-efdbd31af79b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053411 Jul 11 15:59:34.963214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 843/1678] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:34.969912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cddec79a-95b3-499f-bf72-64d22ab901d2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062793 Jul 11 15:59:34.970511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 836/1679] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:35.335676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:35.337206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:35.347376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.348118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.349428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.350169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.381062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3c4ae41a-6701-4c08-9742-fe32b6359336 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052419 Jul 11 15:59:35.381614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 844/1680] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:35.677114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:59:35.677492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 15:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:59:35.850191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:35.851189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:35.861575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.862439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.863699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.864461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.931185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:35.939316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f11f25fb-d8a8-4e2a-acc6-368568188a83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095600 Jul 11 15:59:35.939852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 837/1681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:35.974228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:35.975147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:35.981962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:35.982570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.982830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:35.983072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.983778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.984209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.989499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.989951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:35.990846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:35.991289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:36.015370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3bd3cd77-5ebe-447a-9451-53820f31acb4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045099 Jul 11 15:59:36.015932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 845/1682] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:36.021105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37081025-8bc7-4ecc-bdfb-34df6ae68509 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Jul 11 15:59:36.021664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 838/1683] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:36.397323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:36.398812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:36.406232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:36.406673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:36.407419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:36.407851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:36.437873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-76ac29bf-cc04-42fc-bc5e-09718030c566 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Jul 11 15:59:36.438410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 846/1684] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:36.961187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:36.962166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:36.973841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:36.974581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:36.975870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:36.976687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.028034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:37.028598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:37.034977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.035420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.036198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.036650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.066182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6f21ea61-206a-4f4b-8ad3-65f33f23c770 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042996 Jul 11 15:59:37.066732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 847/1685] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:37.071349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:37.072266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:37.078647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.079231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.079965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.080488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.110886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19af9015-ae48-41e2-82f0-046058b6d174 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 Jul 11 15:59:37.111423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 848/1686] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:37.116658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:37.124648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1c3b363-ef2a-488c-8dd9-d8bfdf3c51fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.170422 Jul 11 15:59:37.125246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 839/1687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:37.450942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:37.451876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:37.458967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.459415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.460159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:37.460616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:37.492327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0983bf4e-fe77-439b-af23-e7b850a4809f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jul 11 15:59:37.492880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 849/1688] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:38.082722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:38.084263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:38.092986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.093436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.094208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.094644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.122990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:38.123943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:38.126191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-834a9df3-9112-4f91-b162-4ea31356684d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050690 Jul 11 15:59:38.126766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 840/1689] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:38.130663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.131110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.131858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.132305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.141244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:38.141844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:38.152569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.152569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.153263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.153691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.165048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b85597c4-0440-489b-b7f0-82c88b28ac11 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Jul 11 15:59:38.165615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 850/1690] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:38.218520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:38.226253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-59ea5ad2-4129-4436-b0d7-aeed9e6f84ee tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088789 Jul 11 15:59:38.226786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 841/1691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:59:38.503901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:38.504865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:38.511238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.511699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.512458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:38.512887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:38.542082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4936104c-8a33-44b1-a5f8-4d50b4a430b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 Jul 11 15:59:38.542634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 851/1692] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:39.142120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:39.143595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:39.156209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.157030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.158386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.159270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.177061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:39.178108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:39.187825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.187825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.187825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.187825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.194779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f305093-ff8a-467b-b84c-3401ae9b6464 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059573 Jul 11 15:59:39.195591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 842/1693] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:39.218041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4957dd0c-5d8f-4625-a76c-b8185476d191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Jul 11 15:59:39.218588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 852/1694] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:39.246063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:39.246898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:39.256254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.256971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.258080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.258736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.326598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:39.338609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5f9f7888-bb27-4f6a-b3ef-b6caa9a2893c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098888 Jul 11 15:59:39.339159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 843/1695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:39.556185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:39.557507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:39.564801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.565298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.566138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:39.566619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:39.600387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d613d63-3183-453e-bcfc-95b4918c1b72 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048707 Jul 11 15:59:39.600958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 853/1696] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:40.207438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:40.208412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:40.215896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.216352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.217134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.217563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.229793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:40.230705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:40.237293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.237698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.238572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.239001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.248589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a824bbd-bfe9-438a-8041-a52815001db5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045520 Jul 11 15:59:40.249151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 844/1697] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:40.268307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be541b51-e14f-4991-a496-255880ee5bfa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 Jul 11 15:59:40.268848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 854/1698] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:40.358662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:40.359657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:40.369989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.370466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.371219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.371652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.443770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:40.452225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cd4fc8d4-7fba-43f0-ab77-04fb0cd8aa10 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100129 Jul 11 15:59:40.452822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 845/1699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:40.616894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:40.618359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:40.628367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.629114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.630344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:40.631055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:40.650025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:40.663537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9a0a46e-5639-422b-8fdc-9010e55fd5cf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053372 Jul 11 15:59:40.664081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 855/1700] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:41.263459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:41.264843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:41.275310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.275831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.276709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.277146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.281058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:41.281228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:41.282240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:41.288663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.289153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.289941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.290389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.308491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-309a2d90-2c36-49b1-a766-9eb4a6105d99 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050938 Jul 11 15:59:41.309047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 846/1701] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:41.319797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-81caf486-1027-404b-aa1c-60b7e9072c39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042498 Jul 11 15:59:41.320336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 856/1702] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:41.473979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:41.474873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:41.483375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.483830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.484653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.485263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.546739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:41.554495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7f57905-f340-4cce-be99-31b726f979f8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087115 Jul 11 15:59:41.555060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 847/1703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:41.679271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:41.680874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:41.688599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.689044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.689796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:41.690229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:41.721578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2528a815-cd26-4022-8201-9077f013a195 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049031 Jul 11 15:59:41.722127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 857/1704] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:42.322083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:42.323052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:42.333400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.334003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.334439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:42.334930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.335521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.335682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:42.343386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.343805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.344609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.345039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.366965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fcd82752-6525-47b8-affd-f9dc2c28e978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050041 Jul 11 15:59:42.367526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 848/1705] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:42.373626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2952264e-b9f8-41d3-9289-d8f9efe13e65 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Jul 11 15:59:42.374174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 858/1706] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:42.571482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:42.572157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:42.580082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.580728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.582251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.582839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.662580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:42.670776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5847a8b0-a584-46d5-b5ca-f5910c80ddda tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103354 Jul 11 15:59:42.671344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 849/1707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:42.738600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:42.740085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:42.750360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.751101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.752371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:42.753103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:42.795779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-08a72abc-3ce7-4e2e-a94f-cec814cf2713 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063754 Jul 11 15:59:42.796340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 859/1708] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:43.383142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:43.384666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:43.388490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:43.389977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:43.395692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.396492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.397746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.398447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.400597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.401249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.402143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.402553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.429465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-77b84f4b-3b1e-44a9-a80c-fd8a2b3119cd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053031 Jul 11 15:59:43.430041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 850/1709] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:43.432464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a34cde38-541c-4fd7-839f-81a0d5e3046c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050494 Jul 11 15:59:43.433238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 860/1710] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:43.691923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:43.692979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:43.701310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.701761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.702526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.702966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.765810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:43.773542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-79265218-496c-4b3e-b315-5d1c280e454f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088120 Jul 11 15:59:43.774124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 851/1711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:43.807690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:43.808686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:43.815366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.815805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.816585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:43.817015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:43.846133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d898110-f75c-425c-b908-520c22022232 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042514 Jul 11 15:59:43.846684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 861/1712] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:44.446199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:44.448056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:44.448329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:44.449003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:44.455047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.455498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.455719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.456172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.456283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.457016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.457271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.457704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.487232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3df80296-d60a-4256-880b-91df32afea9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048099 Jul 11 15:59:44.487691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e7e41ef8-004d-49cb-88d7-ba48b31e210c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Jul 11 15:59:44.487862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 852/1713] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:44.488556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 862/1714] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:44.794721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:44.795730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:44.806106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.806867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.807846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.808284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.860839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:44.861847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:44.868141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.868633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.869396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:44.869949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:44.879234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:44.887275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b9a6929-d186-4376-9074-b5c1bf28e99c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099191 Jul 11 15:59:44.888233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 853/1715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:44.899873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8537cdc8-72e8-4e97-b5e7-180eba83dc26 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 Jul 11 15:59:44.900455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 863/1716] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:45.503848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:45.504789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:45.505399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:45.505561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:45.516533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.516838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.517261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.517515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.518499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.518766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.519221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.519411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.552549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb197676-3e91-42e5-a475-20288eed3af7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055352 Jul 11 15:59:45.553108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 864/1717] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:45.558209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f83aae6-1810-4479-9b42-f3d3cfcb42c2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060610 Jul 11 15:59:45.558778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 854/1718] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:45.909055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:45.910538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:45.915128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:45.916676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:45.919806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.919950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.920704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.921161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.922987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.923436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.924187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:45.924643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:45.955524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-809a7a4e-c061-41db-a84a-6340012a2907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Jul 11 15:59:45.956164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 855/1719] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:46.031911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:46.040011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b45d3876-9549-424e-b886-c9bc11f34653 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.137751 Jul 11 15:59:46.040610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 865/1720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:46.571331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:46.573014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:46.574864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:46.575831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:46.580109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.580597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:46.581371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.582122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:46.583080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.583522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:46.584452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.584873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:46.612489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a76178d1-39c6-407c-891a-cefa88061b8c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050314 Jul 11 15:59:46.613075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 856/1721] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:46.616174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6fb29270-6c8c-49a1-872f-6e5814618aa4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048966 Jul 11 15:59:46.617040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 866/1722] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:46.971629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:46.973040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:46.983385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.984156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:46.985518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:46.986305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.020165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83e62740-7e82-4a31-ab88-9ff9b01893d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055361 Jul 11 15:59:47.020775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 857/1723] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:47.058241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:47.058856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:47.065300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.065746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.066497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.066928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.133506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:47.146436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd71394e-aabf-406f-a989-05ef521f5064 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092072 Jul 11 15:59:47.147343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 867/1724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 15:59:47.627265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:47.628628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:47.630078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:47.631392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:47.638719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.639515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.640658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.641275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.641507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.641936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.643219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:47.643728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:47.674551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7d1d3211-a202-4ad3-b14f-e9781f72041a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053141 Jul 11 15:59:47.675140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 858/1725] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:47.676671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cc5dea54-58eb-42b2-8da1-227bdda46875 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052307 Jul 11 15:59:47.677239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 868/1726] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:48.031538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:48.032670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:48.039407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.039866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.040672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.041111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.070954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d4d2fe6-0682-4111-9501-2bfc636c5926 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Jul 11 15:59:48.071511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 859/1727] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:48.168408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:48.169017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:48.175515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.175970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.176742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.177201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.250626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:48.258542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-667866a4-c551-459b-acfb-f506376cf7f6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095486 Jul 11 15:59:48.259109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 869/1728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:48.687713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:48.688739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:48.689129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:48.690118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:48.695321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.695773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.696581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.697015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.697165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.697680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.698519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:48.699027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:48.728620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5df3e566-fe80-466c-8c51-41672b80205d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044949 Jul 11 15:59:48.729883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58760f54-434d-4ac3-8b02-f9935f38f1f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Jul 11 15:59:48.730330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 860/1729] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:48.733947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 870/1730] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:49.083486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:49.084573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:49.091459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.091981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.092805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.093244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.124124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-944d7783-f108-46a5-8765-89b942689af9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Jul 11 15:59:49.124734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 861/1731] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:49.275362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:49.275943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:49.282604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.283050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.283806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.284243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.354477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:49.362470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf13de79-08d8-47cc-ad77-a994476585dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091093 Jul 11 15:59:49.363015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 871/1732] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:49.746034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:49.747730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:49.748929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:49.750423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:49.759245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.760136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.761595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.761788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.762019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.762124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.762786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:49.763222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:49.766977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:49.788457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:49.793140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a1e17dd1-64c8-4fb3-aacb-3e3d346273a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051243 Jul 11 15:59:49.793842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 872/1733] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:49.794052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b607ab96-3ff7-4215-b0c2-2d797be254b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055331 Jul 11 15:59:49.794611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 862/1734] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:50.140023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:50.141658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:50.151879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.152598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.153358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.153790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.183113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e231e32e-abc3-4383-af50-38a173cb810d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049780 Jul 11 15:59:50.184666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 873/1735] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:50.383538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:50.384629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:50.392009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.392431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.393192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.393628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.399780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:59:50.399944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 15:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:59:50.459340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:50.467415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3eae286a-7565-4c3d-88de-255b75d1470c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090317 Jul 11 15:59:50.467996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 863/1736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:50.809223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:50.809919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:50.810287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:50.810389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:50.817240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.817620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.817837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.818205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.818421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.818851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.818990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:50.819374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:50.850206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c58bcd4-a5a0-46f3-8bcd-3d1edfd27373 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Jul 11 15:59:50.850447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15d4acfc-efd0-41b6-ab76-3fedbf1713fa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047412 Jul 11 15:59:50.850775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 874/1737] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:50.850954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 864/1738] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:51.200087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:51.201050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:51.208167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.208638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.209389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.209815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.239212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a5fd8896-e3ef-42df-acbf-024dd814c9f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Jul 11 15:59:51.239750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 875/1739] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:51.488813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:51.489713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:51.498831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.499293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.500078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.500554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.565485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:51.573231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f540757e-9468-4eee-970a-f36d1f7b53ef tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091260 Jul 11 15:59:51.573779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 865/1740] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:51.862929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:51.863959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:51.866389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:51.867433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:51.872621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.873127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.873970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.874445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.875289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.875836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.876756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:51.877244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:51.905783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f42ab825-64f2-45bd-b966-6dc6bccbd40b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Jul 11 15:59:51.906398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 876/1741] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:51.910074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f13e9cca-cd2a-4719-80b4-399d5c954c8a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048188 Jul 11 15:59:51.910630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 866/1742] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 15:59:52.252124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:52.253063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:52.259554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.260028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.260802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.261204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.289858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1fe52cec-aa7b-442d-b376-e485ef229370 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 Jul 11 15:59:52.290390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 877/1743] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:52.590507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:52.591120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:52.593191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:52.598979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.599429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.600215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.600678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.668263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:52.676486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3dd70779-17b3-4c5c-9796-81ecaa5ee0ba tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090111 Jul 11 15:59:52.677109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 867/1744] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:52.922419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:52.923857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:52.926390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:52.928249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:52.934932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.935373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.936152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.936624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.937423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.937878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.938664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:52.939106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:52.966407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-901cfa13-10eb-4fac-af14-2534b4357594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051096 Jul 11 15:59:52.966970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 878/1745] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:52.969861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1d289f6e-4723-4b4b-8007-106b7039b6f9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050256 Jul 11 15:59:52.970688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 868/1746] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:53.305921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:53.307422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:53.317754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.318491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.319725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.320507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.351584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f8f7f70-4a79-4c09-8fad-c67247c7b56c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052530 Jul 11 15:59:53.352115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 879/1747] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:53.698732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:53.699720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:53.710390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.711128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.712435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.713148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.774906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:53.783084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-55a9894a-7d58-428c-8e75-4de97a1e1dff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090960 Jul 11 15:59:53.783669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 869/1748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:53.980971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:53.981921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:53.985484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:53.986596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:53.989635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.990315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.991073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.995250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.995654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:53.996414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:53.997075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:54.027791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29b2fb1b-c22e-4449-96b1-14bdcd80c11f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047401 Jul 11 15:59:54.028513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 870/1749] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:54.028671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84142f90-b685-4494-a5c1-1f165a05916e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053661 Jul 11 15:59:54.029318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 880/1750] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:54.365819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:54.367260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:54.376542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:54.377002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:54.377782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:54.378220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:54.416944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c6868bb7-2887-4ca5-81fb-d4c378bce207 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056421 Jul 11 15:59:54.418777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 871/1751] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:54.800964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:54.802081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:54.810272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:54.810709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:54.811718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:54.812149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:54.891049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:54.903004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0de2990-c558-4d0c-b4bb-7f57e0fb60b2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.106280 Jul 11 15:59:54.903672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 881/1752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:55.040328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:55.041036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:55.041422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:55.041522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:55.048545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.048708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.048992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.049146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.049745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.049896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.050148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.050305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.080441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eff84826-eb96-4789-9b8a-cf4caf76ebf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jul 11 15:59:55.081042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 882/1753] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:55.081621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ed229316-f36d-4cf3-a5cb-fb118601d21c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Jul 11 15:59:55.082537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 872/1754] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:55.432772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:55.433608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:55.440257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.440730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.441480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.441903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.473479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00ba1915-2a07-477c-9817-ad5cb1d6c883 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Jul 11 15:59:55.474074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 883/1755] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:55.925961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:55.927084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:55.936517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.936962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:55.937716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:55.938141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.010528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:56.018292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c2a18bb-c732-4ac1-8927-be3ca123a324 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099088 Jul 11 15:59:56.019094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 873/1756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:56.094144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:56.095217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:56.095482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:56.096461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:56.102449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.102890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.103651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.103803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.104075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.104254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.105132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.105616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.134290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-facc39ec-81b6-4c74-a6d3-e23f6c3bb1da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jul 11 15:59:56.135051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 884/1757] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:56.137992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8c639b0-a9cc-4877-944b-e54feb54aa5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045459 Jul 11 15:59:56.138588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 874/1758] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:56.486879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:56.487689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:56.494512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.494956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.495701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:56.496171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:56.530168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c922026-f4b1-4353-8f5c-ee9f1c8e2ec5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Jul 11 15:59:56.530734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 885/1759] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:57.039066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:57.040080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:57.047746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.048189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.048977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.049410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.118978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:57.127190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-890ca902-ccd3-4e90-a41c-2112084c88da tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094651 Jul 11 15:59:57.127760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 875/1760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:57.145747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:57.146667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:57.149505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:57.151064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:57.153622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.154080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.154853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.155280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.157977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.158418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.159219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.159658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.184319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9540d4bf-63d4-4a8c-9574-48a35b9672a5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 Jul 11 15:59:57.185151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 886/1761] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:57.190512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b245e1e6-edf4-49bc-bec6-dc4967f447cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044765 Jul 11 15:59:57.191000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 876/1762] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:57.281454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 15:59:57.281723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 15:59:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 15:59:57.619361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:57.620721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:57.628172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.628668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.629423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:57.629850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:57.659651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1018d583-f741-4357-ab88-7f756a6b5335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120722 Jul 11 15:59:57.660241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 887/1763] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:58.148166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:58.149202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:58.157976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.158417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.159190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.159626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.195935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:58.197635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:58.206584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.207562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.208726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.209340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.227260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:58.235997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-db3ffabe-404c-4f31-b236-96efa13c0b70 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094200 Jul 11 15:59:58.236910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 877/1764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:58.237058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:58.241635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:58.242049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5999d3ef-9c6a-4fdb-b312-3f547febf7a7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050741 Jul 11 15:59:58.242758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:58.242880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 888/1765] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:58.249073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.249519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.250276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.250712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.280632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c8d18bd-77d5-4efc-8aa6-379bed0bb4da tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043133 Jul 11 15:59:58.281178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 878/1766] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:58.676176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:58.677696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:58.688697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.689443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.690688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:58.691411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:58.737371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f6b4aab7-8c5d-4bbc-bd64-ddcbc94bebd7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068066 Jul 11 15:59:58.737917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 889/1767] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:59.253649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:59.254223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:59.254626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:59.254786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:59.257150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:59.261362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.261925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.262733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.263173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.263284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.263733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.263931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.264390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.282488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:59.294276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc2ded23-3042-4941-9b8f-8a92b64fef07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Jul 11 15:59:59.294817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 890/1768] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 15:59:59.299439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:59.300356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:59.306284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.306724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.307474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.307901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.327968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 15:59:59.335890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e09571f0-511c-4423-9344-a15632900e01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086264 Jul 11 15:59:59.336488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 879/1769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 15:59:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 15:59:59.339746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-65246de0-6efa-470f-9fe3-fca80a75e778 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Jul 11 15:59:59.340519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 891/1770] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 15:59:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 15:59:59.752353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 15:59:59.753536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 15:59:59.761631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.762196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.763164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 15:59:59.763747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 15:59:59.796648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-783f38d6-417d-49a9-ace2-b6822489b800 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 Jul 11 15:59:59.797210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 880/1771] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 15:59:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:00.310758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:00.312513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:00.323539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.324341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.325847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.326289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.351966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:00.352910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:00.356336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-89417ff9-fe00-4268-bdaf-691556bced4b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052360 Jul 11 16:00:00.360095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 892/1772] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:00.360249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.360415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.361080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.361361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:00.361503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.361967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:00.367891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.368330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.369128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.369562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.391465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a3ee4a5-394e-4058-8406-3befb365d989 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043514 Jul 11 16:00:00.392028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 881/1773] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:00.432175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:00.441572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1ded092-b4ea-458e-8134-a744e6606e31 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.083781 Jul 11 16:00:00.442208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 893/1774] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:00.812892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:00.814036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:00.821751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.822350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.823284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:00.823800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:00.857407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e2db4a6-0ecc-4387-bcee-04209d0980cb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051249 Jul 11 16:00:00.857980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 882/1775] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:01.372741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:01.374320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:01.385718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.386467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.387736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.388413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.403714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:01.404851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:01.411578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.412027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.412814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.413242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.417857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d2c85cd5-8523-4c75-bafb-d5162052e5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051916 Jul 11 16:00:01.418342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 894/1776] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:01.444498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a846cb75-b38b-4d0e-ab87-ba0dd218761c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044930 Jul 11 16:00:01.445003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 883/1777] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:01.464075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:01.464979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:01.471766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.472240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.473005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.473457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.538175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:01.551410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2bcd2df2-d3ed-4bdc-a736-d5de1f1a2522 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092911 Jul 11 16:00:01.552208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 895/1778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:01.871834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:01.873218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:01.882956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.883670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.884976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:01.885636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:01.917023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de51a09f-64c2-4741-82f2-ffc0b4abd774 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050900 Jul 11 16:00:01.917588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 884/1779] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:02.434124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:02.435741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:02.443679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.444169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.445034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.445504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.459281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:02.460327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:02.467432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.467888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.468702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.469147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.478516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cdade8d8-6b60-4d95-8179-5910f3fa4683 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051060 Jul 11 16:00:02.479085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 896/1780] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:02.498754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a7eea7c5-a26d-4381-904a-317b78be4acc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044388 Jul 11 16:00:02.499311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 885/1781] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 16:00:02.574806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:02.575707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:02.582463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.582908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.583661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.584096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.654603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:02.662194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f3520c6a-850a-4367-b6c7-11cf2ad2e449 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093747 Jul 11 16:00:02.662788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 897/1782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:02.930945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:02.932158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:02.939896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.940380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.941154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:02.941594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:02.971629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f3d9a68f-3ec0-4249-aabd-5c7f7e190a8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Jul 11 16:00:02.972199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 886/1783] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:03.496128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:03.497578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:03.508204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.509034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.510294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.511018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.514224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:03.515153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:03.521483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.521938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.522695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.523129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.541535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00751c42-0e64-45de-b4f3-532159853fa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052139 Jul 11 16:00:03.542174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 898/1784] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:03.553166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49d79afe-c35c-4761-88d4-a3b2af282cad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045278 Jul 11 16:00:03.553722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 887/1785] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:03.680760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:03.681508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:03.688496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.688942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.689771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:03.690199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:03.760202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:03.773019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f5fb060-f253-4509-97ca-0f00fc411f3c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096035 Jul 11 16:00:03.773641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 899/1786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:03.988427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:03.990587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:04.000626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.001227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.001974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.002406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.032213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15c382e1-735f-4e27-ad8c-03b41ce83e67 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051385 Jul 11 16:00:04.032728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 888/1787] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:04.558269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:04.559847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:04.565743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:04.566698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:04.566852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.567252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.568009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.568470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.572794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.573253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.574020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.574464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.598049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-36a7bb1b-0c60-4e26-aec7-f857f4bf0e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Jul 11 16:00:04.598634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 900/1788] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:04.605756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6c5913c-35c0-4a77-8bbd-c0f4fa1f4f1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044050 Jul 11 16:00:04.606315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 889/1789] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:04.796172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:04.796809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:04.803228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.803676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.804465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:04.804897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:04.875854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:04.883769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d6860c7-2984-468b-b186-8284ade40037 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093824 Jul 11 16:00:04.884328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 901/1790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:05.046888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:05.047909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:05.054952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.055436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.056235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.056719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.089118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bddd490c-7ddb-4a85-9f84-5f9fd7b9db94 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Jul 11 16:00:05.089694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 890/1791] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:05.614491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:05.616192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:05.621924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:05.623589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:05.627400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.628108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.629433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.630179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.633219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.633966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.635201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.635887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.662386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dfe62940-c0e4-45d3-acaa-a990c7611bc8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054726 Jul 11 16:00:05.662977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 902/1792] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:05.666690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6a2d3fe5-7153-4deb-a9f8-16d428e2ded9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051573 Jul 11 16:00:05.667253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 891/1793] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:05.906664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:05.907577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:05.917894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.918634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.919935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:05.920543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:05.987088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:05.994961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d6aec27-17c3-4835-85c4-74ef0c50e83d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095187 Jul 11 16:00:05.995520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 903/1794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:06.104066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:06.105818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:06.115809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.116426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.117518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.118085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.150774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7505f812-5047-49a6-974e-14710e3aeb9f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052906 Jul 11 16:00:06.151325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 892/1795] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:06.678741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:06.680249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:06.682832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:06.684351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:06.689230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.689930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.690671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.691015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.691171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.691463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.692220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:06.692691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:06.722546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b79186b1-a833-44b2-9226-6138b409f111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050554 Jul 11 16:00:06.723107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 904/1796] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:06.723308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f93aa9d8-0a77-4b2a-8442-7b4bc64043fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047411 Jul 11 16:00:06.723887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 893/1797] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:07.016197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:07.017101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:07.027475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.028209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.029465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.029894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.048141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:07.093975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:07.101604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1be8f97a-ec4f-4668-ad05-0caf9ed19dac tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092287 Jul 11 16:00:07.102163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 905/1798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:07.162911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:07.164327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:07.171390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.171852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.172654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.173100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.205175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fece081-0a36-4281-a10c-77aa69b02f2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Jul 11 16:00:07.205752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 894/1799] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:07.738781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:07.739702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:07.740339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:07.740997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:07.750242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.750434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.750693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.750860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.751452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.751598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:07.751887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.752054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:07.782446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-88daee64-2e9c-492b-b658-518790d9fce3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050227 Jul 11 16:00:07.782725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c37af264-dd1e-4309-a643-534446520448 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050679 Jul 11 16:00:07.783021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 895/1800] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:07.784468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 906/1801] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:08.122729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:08.123849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:08.134508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.135396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.136662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.137383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.142051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:08.200042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:08.209217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e940f49-7087-45e5-b8ff-e6ce156ab439 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093066 Jul 11 16:00:08.209794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 896/1802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:08.217150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:08.218094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:08.224733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.225186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.225922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.226344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.256661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6e08643e-0c6a-4faa-b94e-1d06ec3bddde tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jul 11 16:00:08.257144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 907/1803] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:08.798044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:08.798645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:08.799017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:08.799357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:08.805650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.806095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.806246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.806640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.806863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.807271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.807388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:08.807837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:08.838426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1eb66aba-8230-4406-8b3f-4c40c1943747 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046413 Jul 11 16:00:08.838733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0f7e890-6b5f-49b3-9030-dd7383d03594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Jul 11 16:00:08.838974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 897/1804] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:08.839130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 908/1805] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:09.229865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:09.230682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:09.240885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.241548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.242752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.243417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.269380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:09.270444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:09.276667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.277186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.278003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.278499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.309697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30f1d3cb-cfe1-42b8-ae2f-9be1a228f44b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Jul 11 16:00:09.310117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:09.310655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 909/1806] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:09.318566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-374ec165-5276-40f8-a29a-bc6d91423466 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094904 Jul 11 16:00:09.319151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 898/1807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:09.852058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:09.852868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:09.853357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:09.853475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:09.861836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.862220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.862399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.862803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.863371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.863798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:09.863936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.864431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:09.896744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f83eab11-cefa-4886-96f1-0e1348a59636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Jul 11 16:00:09.897009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c25e0f9-b830-4bc3-a568-633782826c2c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049660 Jul 11 16:00:09.897311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 899/1808] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:09.898077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 910/1809] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:10.325039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:10.326538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:10.334076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.334530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.335290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.335452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:10.335729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.335900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:10.342476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.342940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.343659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.344117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.366656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b7da33d-97ff-4a58-bc1a-db47f5ad160f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048233 Jul 11 16:00:10.367249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 900/1810] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:10.409972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:10.418047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3e026f68-0974-4388-a877-ddc584d2aacf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086895 Jul 11 16:00:10.418630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 911/1811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:10.912918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:10.913846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:10.914459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:10.915147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:10.923410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.923852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.924583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.924714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.925032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.925151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.925829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:10.926249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:10.954910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1d331035-3597-476b-8e24-3aeccc660d57 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049288 Jul 11 16:00:10.955466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 901/1812] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 16:00:10.956066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb986dff-a212-4228-8935-d81f7496b294 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050202 Jul 11 16:00:10.957241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 912/1813] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:11.382644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:11.384129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:11.394995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.395734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.397033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.397749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.429978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8cb0be3-012c-49b5-9197-bde321b97707 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054083 Jul 11 16:00:11.430526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 902/1814] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:11.441490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:11.442108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:11.449714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.450095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.450851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.451286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.516326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:11.524603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-22dcd909-b5ae-4219-b738-58c83663de49 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087445 Jul 11 16:00:11.525166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 913/1815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:11.563226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:00:11.563411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:00:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:00:11.967784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:11.968409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:11.968831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:11.969272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:11.975338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.975787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.976195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.976639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.976750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.977755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:11.977875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:11.978339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:12.008740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-78b8a09d-aa2c-469f-b391-859698b8fb78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045350 Jul 11 16:00:12.008919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77d4228b-4af5-4aed-b314-2b7149481180 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Jul 11 16:00:12.009528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 903/1816] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:12.013121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 914/1817] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:12.443003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:12.443947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:12.451145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:12.451601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:12.452401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:12.452829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:12.484269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e48eb99-4c94-4fe0-a74e-b801675a71fc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Jul 11 16:00:12.485134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 904/1818] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:12.541904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:12.542813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:12.550166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:12.550938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:12.551627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:12.552139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:12.617312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:12.627682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdb0610a-2df2-4f51-814c-24a5dd5b5d4a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089925 Jul 11 16:00:12.628256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 915/1819] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:13.023085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:13.023773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:13.024195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:13.024794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:13.031490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.031996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.032170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.032715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.032889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.033374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.034333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.034839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.065971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-980334ea-d94c-4079-a9a3-ac60e7364107 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047539 Jul 11 16:00:13.066545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 905/1820] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:13.067716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3bd147ad-46e5-4c1a-a46e-e50716d5536d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048640 Jul 11 16:00:13.068282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 916/1821] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:13.502076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:13.503517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:13.510578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.511029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.511794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.512239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.543371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d897783-4d4c-4105-a20e-d778a4882edb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Jul 11 16:00:13.543954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 906/1822] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:13.649410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:13.650532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:13.660233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.660709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.661459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:13.661887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:13.734676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:13.742971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ebe26cf-2cb2-4446-9e3e-04151f48fa01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100808 Jul 11 16:00:13.743558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 917/1823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:14.078605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:14.079771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:14.080967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:14.082460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:14.087477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.087921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.088734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.089012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.089182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.089448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.090207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.090635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.124061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06be0c06-f416-401a-aa12-3c59b5792636 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048009 Jul 11 16:00:14.124663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 918/1824] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:14.128569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-614f7b23-ec61-4b80-8963-b2727b9b4205 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054121 Jul 11 16:00:14.129257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 907/1825] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:14.559691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:14.561214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:14.571734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.572531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.573814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.574562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.606583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ae46d58-ccec-4d56-9933-59add31c1d2d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053843 Jul 11 16:00:14.607109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 919/1826] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:14.769875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:14.770569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:14.778114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.778611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.779454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:14.779923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:14.853219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:14.863272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a3a7f19-085e-45fe-8224-d17b2967cc08 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100017 Jul 11 16:00:14.863923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 908/1827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:15.139443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:15.140769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:15.142701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:15.143934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:15.150304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.150910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.151921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.152561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.152852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.153443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.154437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.155034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.184259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d001eab-3359-4b95-907a-c0097541dafb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050326 Jul 11 16:00:15.185061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 920/1828] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:15.185922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1087dc4-3030-4980-bd67-fd1785676a62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048474 Jul 11 16:00:15.186647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 909/1829] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:15.622731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:15.624271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:15.635197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.635941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.637272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.637985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.671511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-48eda3e7-0885-4ebe-9a60-c107df3f117b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055523 Jul 11 16:00:15.672069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 921/1830] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:15.883286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:15.883808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:15.890656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.891133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.891914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:15.892353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:15.963353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:15.971535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e722003-abf2-4c73-943c-79b25860f3d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094342 Jul 11 16:00:15.972103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 910/1831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:16.199451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:16.200036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:16.200460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:16.200559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:16.207681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.208044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.208515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.208683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.209453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.209866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.210024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.210701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.214488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:16.243717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8d5e7df7-b486-4410-b398-c38cf0d11888 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049458 Jul 11 16:00:16.244543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 922/1832] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:16.244857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8354bf2a-394a-4ea1-907d-eff1157ea6a8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049372 Jul 11 16:00:16.245628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 911/1833] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:16.688324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:16.689861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:16.698184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.698667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.699417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:16.699868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:16.728908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d0efbbed-df82-45ff-ae00-32d0f4604d02 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 Jul 11 16:00:16.729451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 923/1834] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:16.992543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:16.993202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:17.001560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.002091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.002983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.003502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.067590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:17.071656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:17.076243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-47414dd1-a4d6-4f89-a570-23babf4b79e6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090182 Jul 11 16:00:17.076855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 912/1835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:17.260263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:17.261152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:17.261725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:17.262664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:17.272441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.273695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.273838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.274201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.274468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.274903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.275055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.275380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.304975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18a214c5-7a10-4c56-a066-2d90136467e2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050805 Jul 11 16:00:17.305206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d015968a-60db-442a-93f1-741484976cf0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051681 Jul 11 16:00:17.309031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 924/1836] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:17.309196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 913/1837] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:17.746768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:17.748359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:17.758470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.759210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.760502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:17.761223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:17.795277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa80359a-b5d6-41eb-a5e0-2b9b19777389 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055224 Jul 11 16:00:17.795821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 925/1838] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:18.096864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:18.097878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:18.105925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.106409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.107146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.107575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.181078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:18.189549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac18eccb-aed1-49ef-9a4b-cb258a9d6b1c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099227 Jul 11 16:00:18.190220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 914/1839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:18.320400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:18.321098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:18.321483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:18.321708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:18.327826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.328273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.328443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.328915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.329055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.329504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.329658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.330121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.360712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-72a3c848-878c-4511-9484-fb56cd3f5c96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Jul 11 16:00:18.360975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-52211967-1d53-48f2-8c6c-8b4e93cdad41 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046929 Jul 11 16:00:18.361518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 926/1841] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:18.361802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 915/1841] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:18.811640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:18.813179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:18.824082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.824879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.826133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:18.826935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:18.860982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c30737e7-84ec-47a5-80c0-71d66667cbe7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056928 Jul 11 16:00:18.861518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 927/1842] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:19.207553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:19.208165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:19.215914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.216346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.217134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.217567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.279892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:19.288166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2145e1ca-8563-4936-8cac-adb1acefbc04 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084885 Jul 11 16:00:19.289236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 916/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:19.376867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:19.377861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:19.378493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:19.378678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:19.381278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:19.390028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.390774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.391014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.391696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.392249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.393010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.393250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.393768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.425001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e88a263a-b098-44bf-b6b4-711a627b212c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054986 Jul 11 16:00:19.425546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-723252a7-649e-4629-9875-c4d7e94ecfa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055551 Jul 11 16:00:19.425722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 928/1844] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:19.426101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 917/1845] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:19.877160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:19.878680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:19.886627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.887075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.887833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:19.888269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:19.917848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9c6891f-4091-42e1-b5cb-772ff2b9c50e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Jul 11 16:00:19.918384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 929/1846] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:20.310071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:20.311091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:20.322982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.323744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.325074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.325773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.399942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:20.408247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-474b168d-2dbe-4df1-80e5-5595825f8c6e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105032 Jul 11 16:00:20.408853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 918/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:20.436965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:20.437163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:20.437872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:20.438055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:20.444309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.444778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.445153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.445537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.445678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.445967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.446337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.446768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.476697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-09b72613-527f-4d44-a84c-99f5306dba5d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043446 Jul 11 16:00:20.476953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cad42b59-37c3-4f96-98fa-06664c483a3b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Jul 11 16:00:20.477256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 919/1848] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 16:00:20.477392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 930/1849] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:20.933165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:20.934285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:20.942008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.942581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.943653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:20.944193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:20.977016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-838bd5e7-e582-49ae-b1ff-e0991bbf97de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049789 Jul 11 16:00:20.977562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 920/1850] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:21.429669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:21.430700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:21.441101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.442063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.443053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.443776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.489931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:21.490739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:21.497898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.498334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.499100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.499502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.507898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:21.515526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-da692e8d-62bf-4a93-ad33-c4e61362b291 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092554 Jul 11 16:00:21.516358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 931/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:21.520612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:21.521520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:21.527608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.528062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.528853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:21.529287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:21.531079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-699c53bd-525d-4a2c-b759-409f0c2531aa tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046301 Jul 11 16:00:21.531674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 921/1852] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:21.558240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49297b32-0bac-4ed6-a73f-93413cb2838c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Jul 11 16:00:21.558780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 932/1853] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:21.993117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:21.994607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:22.004975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.005717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.007166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.007661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.038633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52341e2f-9704-49bc-acda-ad8062be9adc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052049 Jul 11 16:00:22.039204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 922/1854] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:22.532090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:22.532725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:22.539955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.540457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.541323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.541756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.543337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:22.544264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:22.550860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.551313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.552443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.552962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.586252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-727c2146-3268-4e49-b261-e018bf32ce1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046814 Jul 11 16:00:22.586828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 923/1855] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:22.591708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:22.592673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:22.599032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.599475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.600230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:22.600865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:22.610857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:22.618751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-157c5517-5f29-4e4e-a690-851b256512f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090611 Jul 11 16:00:22.619333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 933/1856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:22.630437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-56abcf08-b3e7-42d0-9573-3862499b5071 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Jul 11 16:00:22.630988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 924/1857] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:23.054102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:23.055139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:23.062407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.062906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.063778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.064263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.096022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6ddf5cc-0393-4607-8479-884abcecadb8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048638 Jul 11 16:00:23.096607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 934/1858] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:23.602472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:23.603683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:23.611758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.612315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.613260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.613775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.635893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:23.636496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:23.643381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.643831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.644625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.645062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.647872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae076688-149b-4969-8c3d-fd03b17e7678 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052241 Jul 11 16:00:23.648560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 925/1859] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:23.653309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:23.654350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:23.660553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.661006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.661763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:23.662194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:23.691652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd0f4186-22cd-44f7-9018-e248590a327d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 Jul 11 16:00:23.692220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 926/1860] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:23.708840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:23.716920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5728f936-9b9c-4b27-9c68-da3abd4958d7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085504 Jul 11 16:00:23.717500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 935/1861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:24.108711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:24.109628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:24.115753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.116473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.117225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.117661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.147815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd0445e5-8949-4353-84d5-bcec886aa3e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Jul 11 16:00:24.148399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 927/1862] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:24.665197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:24.666554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:24.677594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.678339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.679882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.680318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.703373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:24.704334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:24.709981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b9b8288-eba0-49bf-be32-31b27d652d1c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052409 Jul 11 16:00:24.711156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 936/1863] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:24.712052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.712546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.713334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.713775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.733487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:24.734341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:24.740670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.741093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.742531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:24.742970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:24.743892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14dfcca1-ef6a-455b-a681-709fd216f6e9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Jul 11 16:00:24.744546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 928/1864] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:24.808649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:24.820432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bbee2f81-2987-4838-8585-12cd4e5a3f79 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090399 Jul 11 16:00:24.821252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 937/1865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:00:25.163611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:25.165102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:25.174532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.175128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.176235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.176868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.195960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:25.210402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4381f1c1-372f-4d1e-9d1f-a3a37953bfaf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053737 Jul 11 16:00:25.211027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 929/1866] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:25.723074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:25.724010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:25.731528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.731975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.732767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.733231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.756770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:25.758018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:25.759996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:25.764973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.765432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.765613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2784c81-6f4a-4060-bbb2-c654400bbfef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046640 Jul 11 16:00:25.766113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 938/1867] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:25.766258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.766618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.796167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a9df4df7-3ad8-44a6-af87-3b9940c1d59f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Jul 11 16:00:25.796761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 930/1868] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:25.846184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:25.847044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:25.854955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.855403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.856165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:25.856633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:25.930429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:25.942149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e376ea38-a4cf-47ec-a881-44e536c65a4c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101867 Jul 11 16:00:25.942965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 939/1869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:26.222718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:26.223655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:26.230883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.231367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.232127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.232598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.264325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b53ff8f-cbfa-4d61-894f-7ad15d55bb6a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Jul 11 16:00:26.264913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 931/1870] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:26.782613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:26.783987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:26.787777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:26.797564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.798344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.799607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.800362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.808876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:26.809794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:26.816670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.817115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.817875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.818278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.831601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12f64b4c-40eb-4273-a06c-d22cfbec50b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056070 Jul 11 16:00:26.832599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 940/1871] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:26.850573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c8172e39-ea45-4cf7-97d5-08e07e3e3a9f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Jul 11 16:00:26.851130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 932/1872] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:26.964005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:26.964913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:26.973191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.973786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:26.974803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:26.975386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.044229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:27.052321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a87c287-74b4-492e-95b9-d3f0dfe5efa3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094110 Jul 11 16:00:27.052919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 941/1873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:27.280710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:27.282203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:27.291193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.291712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.292441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.292878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.321940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea0489b4-3b40-4a8f-812b-10060eeb3285 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Jul 11 16:00:27.322479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 933/1874] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:27.848348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:27.849861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:27.857327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.857766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.858518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.858948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.861707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:27.862630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:27.869598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.870050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.870817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:27.871252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:27.888884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-86eda95d-718b-42dc-896c-bc4b0f6bf865 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047150 Jul 11 16:00:27.889476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 942/1875] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:27.901484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11df707c-420a-49b8-b833-c76de276a92d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Jul 11 16:00:27.902059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 934/1876] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:28.072331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:28.072949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:28.079625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.080071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.080877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.081328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.154044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:28.162054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7c7c6a76-a303-4059-ad8b-25c96bda8e57 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095615 Jul 11 16:00:28.162621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 943/1877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:28.338495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:28.339699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:28.347590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.348149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.349136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.349675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.384169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ba99784-0e39-4ae6-801e-6126f70e3619 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052181 Jul 11 16:00:28.384766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 935/1878] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:28.905368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:28.906846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:28.915995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.916389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:28.916867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.917284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.917425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:28.917722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.924130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.924614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.925374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:28.925813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:28.947979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31e7a52e-cce4-43c2-8817-8b75baeb61f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049329 Jul 11 16:00:28.948794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 944/1879] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:28.956482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-81f8302f-ab74-41f4-abdc-6dfdc9ef15f6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Jul 11 16:00:28.957392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 936/1880] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:29.181687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:29.182239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:29.189030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.189476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.190503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.190608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.252953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:29.261352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8a325e9-166c-4783-9e19-2e6bbab0421f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084791 Jul 11 16:00:29.261914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 945/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:29.399449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:29.400964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:29.410981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.411736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.413163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.413927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.446757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-066213c4-a1a7-4591-bb8d-c2f4ed4b9d11 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054243 Jul 11 16:00:29.447337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 937/1882] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:29.962928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:29.963975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:29.969755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:29.970800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:29.971476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.971973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.972841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.973314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.978161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.978666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:29.979511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:29.979995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:30.004327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c03c439-c2a9-4545-a857-f808a8c9fb9b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047608 Jul 11 16:00:30.004856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 946/1883] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:30.011170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef39629e-635c-4a08-a43b-f674f7f8fe07 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Jul 11 16:00:30.011875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 938/1884] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:30.283556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:30.284490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:30.292331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:30.292813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:30.293573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:30.294008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:30.357479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:30.365026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b978c47b-7dbd-48b3-b2c8-a9888a564c3f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088075 Jul 11 16:00:30.365596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 947/1885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:30.462211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:30.463138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:30.469618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:30.470073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:30.470832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:30.471267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:30.501264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ca0093f5-7d06-49c0-a9b2-1ce59c4c6e56 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Jul 11 16:00:30.501822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 939/1886] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:31.020807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:31.022290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:31.027176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:31.028705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:31.034352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.035126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.036383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.037140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.039091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.039535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.040304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.040744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.067377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1853e165-8e1e-4b8d-affc-2785775ad55b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053625 Jul 11 16:00:31.068188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 948/1887] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:31.070459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7417b6d4-e9c9-47b4-8322-5f23cc6ccbd3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Jul 11 16:00:31.071044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 940/1888] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:31.386721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:31.387757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:31.397958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.398409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.399181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.399642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.464987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:31.476352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6b2ec28-969e-4c57-85a4-17e29a50f6f2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096059 Jul 11 16:00:31.477625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 949/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:31.513850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:31.514788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:31.521326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.521777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.523084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:31.523535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:31.554619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11efeedf-27ba-45b7-90fe-bf635bf0938a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Jul 11 16:00:31.555185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 941/1890] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:32.080270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:32.081138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:32.081577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:32.082404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:32.088833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.089289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.089616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.090049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.090209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.090484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.090806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.091219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.120804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9f9760f-70a8-48f2-9458-9c3f7b92a271 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Jul 11 16:00:32.121410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 950/1891] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:32.122655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b500b05-d7ba-4d17-9a84-8100ba2e2920 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Jul 11 16:00:32.123221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 942/1892] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:32.498047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:32.499027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:32.508534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.508977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.509721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.510149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.568445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:32.569767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:32.576561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:32.577025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.577468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.578229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:32.578655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:32.585826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b6d47b7c-cc90-4601-8a1b-4c17344b12e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094198 Jul 11 16:00:32.586411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 951/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:32.609387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-424343bc-c7b8-4cd3-9a97-53aafc398fdc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Jul 11 16:00:32.609951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 943/1894] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:00:33.135767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:33.136857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:33.137446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:33.138514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:33.144617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.145112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.145395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.145899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.146075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.146437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.146743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.147203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.179236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a7543f2-8480-44a7-b3bc-d3211798eeb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048736 Jul 11 16:00:33.179683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 952/1895] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:33.180021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac765c3d-f403-4e3d-b9d1-590040337f54 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Jul 11 16:00:33.180629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 944/1896] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:33.607721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:33.608810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:33.618679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.619107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.619898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.620334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.622908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:33.623884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:33.630707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.631158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.631922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:33.632387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:33.663194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29a64106-db9a-41a1-89ed-5f8f1dcb3f91 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jul 11 16:00:33.664096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 945/1897] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:00:33.683788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:33.691985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a51d41ca-2b7d-4f7d-85c6-4997d4d3fe81 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091365 Jul 11 16:00:33.692601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 953/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:34.193052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:34.193617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:34.194299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:34.194902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:34.203338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.203947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.204272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.204762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.204954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.205563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.205766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.206310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.210959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:34.237526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4bf67a45-8413-4734-98b1-beef73f6c5a1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049167 Jul 11 16:00:34.237808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97c7ff83-4e75-4a32-b209-63a3cfd8b7c0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050361 Jul 11 16:00:34.238115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 954/1899] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:34.238622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 946/1900] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:34.675738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:34.676811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:34.685846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.686451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.687564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.688140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.708768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:34.711906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:34.712750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:34.722056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.722530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.723701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:34.724152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:34.728320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8dec7965-28d7-4ae4-845d-caa86c9a2e1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057158 Jul 11 16:00:34.729106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 955/1901] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:34.787269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:34.795392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d451808-8cc0-4a20-9a65-7ae4325f7d2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089756 Jul 11 16:00:34.795969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 947/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:35.250482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:35.251052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:35.251413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:35.251513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:35.258151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.258429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.258566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.258904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.259371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.259671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.259828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.260218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.290207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45fcd5f5-4e7c-4b4d-b9d4-91a17944c8a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Jul 11 16:00:35.290773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a2943b2-00ef-448c-83e7-48856d7acd78 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044141 Jul 11 16:00:35.290953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 956/1903] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:35.291575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 948/1904] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:35.740388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:35.741317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:35.749429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.749876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.750638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.751069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.781546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4d802ed-66de-4acf-ad28-4ce70cf8ae00 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Jul 11 16:00:35.782093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 957/1905] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:35.812671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:35.813295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:35.819985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.820918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.821685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:35.822119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:35.890289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:35.901389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6277d42-430e-46a6-8225-4c037bbfb167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092593 Jul 11 16:00:35.902021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 949/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:36.302307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:36.302973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:36.303409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:36.303897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:36.310393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.310563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.310846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.311002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.311616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.311797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.312048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.312403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.343154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df0efdd2-9a5d-4c2a-9931-a4913d025ebf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044264 Jul 11 16:00:36.343393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-09235bec-4742-486f-9aed-53a10c36d94b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Jul 11 16:00:36.343980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 958/1908] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:36.344119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 950/1908] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:36.795401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:36.796330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:36.802977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.803422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.804182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.804663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.834439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0961d85b-758b-483f-a95c-205782e1b998 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043022 Jul 11 16:00:36.835005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 959/1909] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:36.922446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:36.923093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:36.930758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.931222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.931994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:36.932466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:36.999167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:37.009660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6b4b896-6f69-4a3e-bf31-0e764db012a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091156 Jul 11 16:00:37.010234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 951/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:37.354890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:37.355504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:37.355873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:37.355973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:37.362402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.362609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.362852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.363058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.363612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.363851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.364007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.364264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.394210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-afb66014-ddf8-4c63-b251-9d453046f406 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Jul 11 16:00:37.394479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d5bc7d4-e3eb-4de0-b153-9aa6bd5b1cdf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043182 Jul 11 16:00:37.394779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 960/1911] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:37.394941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 952/1912] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:37.848894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:37.849965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:37.857010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.857464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.858260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:37.858695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:37.889236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57851bc6-49b5-4668-b58c-feb4ed31ada8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Jul 11 16:00:37.889796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 961/1913] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:38.028348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:38.028995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:38.036698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.037244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.038089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.038567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.105441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:38.113500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7d63d6bb-625b-4d9c-8d59-d856bba6d418 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089501 Jul 11 16:00:38.114301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 953/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:38.409352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:38.410183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:38.410775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:38.411117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:38.418517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.418959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.419128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.419412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.419727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.420154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.420345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.420625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.450431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f69a77c-07f7-4f7b-ab74-be7494cbb0d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Jul 11 16:00:38.450811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1de8522e-8123-4d6c-800d-1fda6919026c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047377 Jul 11 16:00:38.454636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 962/1915] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:38.454892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 954/1916] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:38.902248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:38.903171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:38.909729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.910181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.910939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:38.911372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:38.943056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ec702319-4e67-4331-8be6-d37be0fef183 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Jul 11 16:00:38.943605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 963/1917] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:39.134285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:39.134901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:39.141841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.142287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.143041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.143475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.211049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:39.219064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d9a2e55-9972-428d-b104-28d2f21f3cbf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090400 Jul 11 16:00:39.219630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 955/1918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:39.463403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:39.463975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:39.464371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:39.464749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:39.471218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.471408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.471669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.471823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.472487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.472639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.472918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.473082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.502529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-751f972e-d551-41d6-b185-134fec774d86 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Jul 11 16:00:39.503093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 964/1919] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:39.503270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2ff33af-df6d-4cba-8d36-28d25e181b90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043725 Jul 11 16:00:39.503821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 956/1920] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:39.959498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:39.960800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:39.967817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.968258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:39.969051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:39.969479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.006364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-02f3569c-e954-4994-bd6f-ddf12e28ca37 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053577 Jul 11 16:00:40.007053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 965/1921] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:40.236148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:40.236720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:40.243897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.244383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.245143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.245575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.319920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:40.327842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2de453c9-5977-4693-8040-48efc893b24f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095687 Jul 11 16:00:40.328445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 957/1922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:40.514778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:40.515345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:40.515720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:40.515819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:40.522396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.522604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.522842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.523002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.523690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.523848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:40.524189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.524680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:40.553952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-118e5653-c637-4017-b2e6-ccf6d829cfc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 Jul 11 16:00:40.554223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-79353130-62ee-4fb4-807b-5d263f47101c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043369 Jul 11 16:00:40.554865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 966/1923] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:40.556442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 958/1924] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 16:00:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:41.018785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:41.019731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:41.026605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.027052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.027809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.028242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.058668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-415bfb86-70af-4cd8-8f64-5cfebc4ddccd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Jul 11 16:00:41.059218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 967/1925] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:41.346344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:41.347057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:41.355193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.355654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.356453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.356890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.428181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:41.436273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d483f4e-b863-4c49-9df2-d22c5a252332 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094448 Jul 11 16:00:41.436878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 959/1926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:41.566452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:41.567055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:00:41.567433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:41.567540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:41.574536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.574993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.575161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.575505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.575753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.576185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.576358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:41.576756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:41.607065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-99097e22-7a3f-4dcb-aecb-ed977d3b8c22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Jul 11 16:00:41.607547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 968/1927] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:41.660335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f43b05fa-1e65-4a45-bf33-b4579167d05f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action" status: 200 len: 37905 microversion: 2.20 time: 0.097524 Jul 11 16:00:41.661277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 960/1928] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 11 16:00:41 2022] POST /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd/action => generated 37905 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:00:42.071509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:42.072457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:42.079144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.079561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.080383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.080821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.111539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-36620044-f757-4982-84a7-046cf7f7218d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Jul 11 16:00:42.112091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 969/1929] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:42.458875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:42.460079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:42.467946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.468439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.469228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.469664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.532469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:42.540663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44186a9b-af73-4696-af82-6f813b7de98b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089354 Jul 11 16:00:42.541226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 961/1930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:42.619176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:42.620126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:42.626697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.627141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.627888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:42.628318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:42.657199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1312aa6a-c77a-457a-814d-9d23dd002c47 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042158 Jul 11 16:00:42.657748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 970/1931] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:43.124622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:43.125612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:43.133723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.134184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.134966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.135405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.165105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4af35095-d90f-4d60-84bf-2c887d269325 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Jul 11 16:00:43.165661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 962/1932] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:43.559221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:43.559822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:43.566636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.567085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.567828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.568254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.636845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:43.644795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-515246ab-0d25-4d64-a068-30c98cb55ad9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090431 Jul 11 16:00:43.645354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 971/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:43.671470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:43.672795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:43.682669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.683143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.684183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:43.684796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:43.690633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:43.718239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d0c4c77f-76c9-4768-9088-d8fc01d9331b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052903 Jul 11 16:00:43.718816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 963/1934] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:44.181259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:44.182192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:44.188736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.189504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.189923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.190350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.194026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:44.220689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9112c940-6ae4-469f-9451-2850a0e09925 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Jul 11 16:00:44.221258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 972/1935] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:44.665929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:44.666614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:44.673730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.674207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.674998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.675464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.733785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:44.734949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:44.744641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.745097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.745863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:44.746300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:44.749824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:44.758176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6dfcdbaf-9d4e-4a23-8251-fdd42b720df5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097818 Jul 11 16:00:44.758754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 964/1936] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:44.775975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-417e3f7c-4467-4872-baa2-35f953a66e88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 Jul 11 16:00:44.776575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 973/1937] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:45.233583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:45.234467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:45.241421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.241904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.242963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.243401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.274091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-488464e3-c07d-49e1-b09e-3e50cd08f540 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Jul 11 16:00:45.274642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 965/1938] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:45.778156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:45.778944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:45.787901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.788525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.789589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.790160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.790347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:45.791464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:45.799808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.800420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.801413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:45.801993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:45.832154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b71959ca-e827-4445-abde-5a47f76719c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Jul 11 16:00:45.832766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 966/1939] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:45.858241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:45.865974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0f409d8a-d520-4236-b4f5-ba8b7e59103d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093282 Jul 11 16:00:45.866530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 974/1940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:46.289823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:46.291190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:46.294529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:46.302277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.302938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.303956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.305372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.336275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0afe42e2-e272-46e3-a31c-d46897ca575c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052598 Jul 11 16:00:46.336864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 967/1941] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:46.847724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:46.849266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:46.856878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.857329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.858085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.858521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.887070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:46.887695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e28bb9f-a1e4-48ad-9acf-58d107dc7ddf tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046521 Jul 11 16:00:46.887877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:46.888100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 975/1942] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:46.896263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.896922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.898197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:46.898785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:46.973585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:46.981838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aec70c71-96fe-448e-a9d6-e212f786a352 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098657 Jul 11 16:00:46.982414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 968/1943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:46 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:47.352134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:47.353389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:47.361649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:47.362247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:47.363249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:47.363822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:47.397848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-83d26dfe-ab23-45af-b999-84db1292bb57 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052346 Jul 11 16:00:47.398430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 976/1944] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:47.903894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:47.904849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:47.911771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:47.912218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:47.913006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:47.913438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:47.950558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9fd57cca-9e6b-47b9-a11e-410827d6cd02 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Jul 11 16:00:47.951364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 969/1945] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:48.002820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:48.003871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:48.015208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.015954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:48.017365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.018086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:48.084726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:48.096803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a6070a18-67b2-4d7f-b30a-d810fda59474 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100093 Jul 11 16:00:48.097528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 977/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:48.415451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:48.416604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:48.423846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.424403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:48.425286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.425793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:48.460477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e4fc92d7-3e1f-4a6d-9830-f7936d72e6d2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051298 Jul 11 16:00:48.460992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 970/1947] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:48.966015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:48.967267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:48.976821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.977268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:48.978031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:48.979103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:49.007793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b34b4f2a-7058-4fee-889d-28bad160776f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047877 Jul 11 16:00:49.008739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 978/1948] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:49.115421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:49.116703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:49.125911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:49.126511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:49.127630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:49.128278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:49.195515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:49.203370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3fe905c6-af17-462e-83d9-23af55944308 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091946 Jul 11 16:00:49.203934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 971/1949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:49.478143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:49.479659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:49.491516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:49.492335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:49.493087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:49.493520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:49.524720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a33d92bf-52b2-4bbf-b1d5-0cdfb4ff6444 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053209 Jul 11 16:00:49.525267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 979/1950] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:50.023482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:50.024651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:50.032402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.032844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.033612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.034042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.064277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1dc46428-baeb-44bf-ada7-4052666b001b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Jul 11 16:00:50.064883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 972/1951] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:50.220747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:50.221390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:50.231409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.232172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.233813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.234610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.296369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:50.304067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e0334c1-ecae-4fb6-adb8-57a87113246d tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087324 Jul 11 16:00:50.305329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 980/1952] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:50.538602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:50.539982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:50.547100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.547663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.548473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:50.548938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:50.580055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8137820-2c8c-4658-a0d9-7c09a82230f0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Jul 11 16:00:50.580889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 973/1953] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:51.080574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:51.082388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:51.094030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.094817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.096098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.096920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.127496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2e05b8ee-ee74-4bce-a0ba-422b41216533 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053725 Jul 11 16:00:51.128043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 981/1954] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:51.323478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:51.324174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:51.331254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.331681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.332884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.333359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.397116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:51.404893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0e487e4-48f4-44d7-93b3-a9f6941dca01 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086533 Jul 11 16:00:51.405451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 974/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:51.592412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:51.593243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:51.599567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.600008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.600797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.601279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.631183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-404994b7-4951-4d2a-a651-fda0cd868563 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Jul 11 16:00:51.631743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 982/1956] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:51.868227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:51.868788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:51.878534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.879105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.880222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.880902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.907004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:00:51.963557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.compute.api [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Instance is already in deleting state, ignoring this request Jul 11 16:00:51.964894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a7b3f2ec-7990-4b0e-be49-effcb01f0e86 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 204 len: 0 microversion: 2.1 time: 0.102488 Jul 11 16:00:51.965773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 975/1957] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:00:51 2022] DELETE /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:00:51.975613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:51.976366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:51.982555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.982993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:51.983736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:51.984160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:52.057108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:52.065257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ed0b16fe-9822-4502-ac88-c850c14d49a8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093479 Jul 11 16:00:52.065820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 983/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:52.143666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:52.145080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:52.155133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:52.155895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:52.157204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:52.157934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:52.190130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80e8c4f3-52c6-4ee8-b154-ea5d2e99b932 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053305 Jul 11 16:00:52.190637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 976/1959] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:52.645313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:52.646496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:52.656010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:52.656653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:52.657651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:52.658855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:52.689439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c31744d-a04f-4800-9f98-5702894d802a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049650 Jul 11 16:00:52.689985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 984/1960] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:53.083600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:53.084190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:53.091761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.092221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.092994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.093429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.159070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:53.167168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a90a39ea-b6f7-4ec3-9cc1-354eedffd460 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088035 Jul 11 16:00:53.167739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 977/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:53.203475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:53.204537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:53.211506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.211943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.212724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.213135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.243354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a97aab2-b7fd-40aa-929b-983e4100097d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Jul 11 16:00:53.243908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 985/1962] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:53.705974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:53.707937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:53.718211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.718974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.720235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:53.721018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:53.740075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:53.754351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-697ee9ed-2bff-48f1-ba33-985ac4ecbb09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055099 Jul 11 16:00:53.754908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 978/1963] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:54.186614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:54.187404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:54.197047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.197504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.198306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.198742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.261802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:54.262883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:54.271015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.271742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.273147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.273908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.275422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:54.287450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7764aa61-5734-464b-8fe1-241daa36ff3b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105871 Jul 11 16:00:54.288258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 986/1964] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:54.314714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-77d3d13d-5629-4e64-b4b0-043cc00ef704 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057760 Jul 11 16:00:54.317178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 979/1965] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:54.769103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:54.770273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:54.778001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.778457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.779552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:54.779988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:54.825437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0cb05a76-d6a4-4c88-9c2c-831cfafb7d29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061971 Jul 11 16:00:54.826044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 987/1966] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:55.313525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:55.314412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:55.323296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.323744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.324543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.324975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.328471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:55.329466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:55.336473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.336924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.337695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.338125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.364863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:55.370182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-abec0677-735a-41f4-9b26-08d2f505d6fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 Jul 11 16:00:55.370749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 988/1967] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:55.390836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:55.398653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-729ca9e0-53a2-49af-a647-933ac20e8393 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090980 Jul 11 16:00:55.399217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 980/1968] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:55.842852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:55.844355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:55.854772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.855506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.856893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:55.857665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:55.890441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32ab9483-2ba6-4484-83ff-a5734e702351 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054732 Jul 11 16:00:55.890974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 989/1969] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:56.385959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:56.387470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:56.398805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.398978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.399676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.400357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.415101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:56.415787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:56.418125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:56.423655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.424096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.424875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.425304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.430537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7db2a20-fdff-46dc-9d23-6822b9b3c80d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050541 Jul 11 16:00:56.434361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 981/1970] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:56.491803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:56.501626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-667f6dd9-3cfd-40d3-84da-ecea0e6efcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090378 Jul 11 16:00:56.502197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 990/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:56.904471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:56.905608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:56.913492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.914288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.915440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:56.915876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:56.949413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-819a4a45-b94b-4157-a32b-254c9606a205 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Jul 11 16:00:56.949980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 982/1972] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:57.446750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:57.448130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:57.459427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.460187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:57.461377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.461815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:57.490581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-618417b8-a152-4cf6-ac3b-adf1d2d28589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Jul 11 16:00:57.491122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 991/1973] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:57.518727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:57.519460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:57.526596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.527046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:57.527835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.528249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:57.602474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:57.610446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c9c327be-9690-45ce-bcb9-98534e90661b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095670 Jul 11 16:00:57.610997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 983/1974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:57.965923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:57.967452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:57.977734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.978376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:57.979674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:57.980378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:58.015521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dbe80115-162a-486a-8af0-3d2bf009d338 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056473 Jul 11 16:00:58.016070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 992/1975] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:58.504131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:58.505315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:58.512318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:58.512795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:58.513561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:58.513997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:58.543567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-629e5f5c-7a7a-468c-81be-115f53091773 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Jul 11 16:00:58.544237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 984/1976] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:58.631521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:58.632945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:58.644189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:58.644954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:58.646187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:58.646902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:58.722793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:58.733740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5427ff73-1ca2-4b9c-9389-0c0bf1968a78 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.108291 Jul 11 16:00:58.734527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 993/1977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:00:59.031671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:00:59.033193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:59.046819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.047285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.048076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.049206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.122690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eb2b8373-93c4-4ada-bb79-e6167abc0277 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action" status: 200 len: 76338 microversion: 2.1 time: 0.097306 Jul 11 16:00:59.123730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 985/1978] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 16:00:59 2022] POST /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e/action => generated 76338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:00:59.558780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:59.560070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:59.569458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.570444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.571618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.572461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.607173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2b0ad584-177c-44d1-aded-0888f3baa67d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054765 Jul 11 16:00:59.607695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 994/1979] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:00:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:00:59.758830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:00:59.760329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:00:59.768132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.768646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.769447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:00:59.769913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:00:59.835630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:00:59.844336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9848050b-edcc-4aef-8e9a-208999cf7822 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093353 Jul 11 16:00:59.845037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 986/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:00:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:00.623446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:00.624976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:00.635067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:00.635631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:00.636427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:00.636858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:00.666424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78ce7ea1-24f7-4822-95f9-f0f913efc516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049797 Jul 11 16:01:00.666957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 995/1981] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:01:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:01:00.862264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:00.863004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:00.870386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:00.870826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:00.871583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:00.872032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:00.947335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:00.955180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-339a2a0c-6b42-4edd-bae0-94006b938b5e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097317 Jul 11 16:01:00.955721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 987/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:01.682183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:01.683359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:01.690978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:01.691472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:01.692308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:01.692794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:01.724724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab37c198-b1a6-4218-87c2-7ce9718a63c5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048812 Jul 11 16:01:01.725260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 996/1983] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:01:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:01:01.976413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:01.976970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:01.984059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:01.984546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:01.985313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:01.985752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:02.047513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:02.055903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39cc24ea-8eb2-4855-b90c-92e406f865d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086443 Jul 11 16:01:02.056506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 988/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:02.740786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:02.742250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:02.753291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:02.754026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:02.755264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:02.755972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:02.785399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-925fb0d3-eb7f-49f7-aa90-41107ba6ffa6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051279 Jul 11 16:01:02.785932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 997/1985] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:01:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:01:03.080828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:03.081611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:03.091167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.091802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:03.092906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.093500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:03.158147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:03.165993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-34d23d16-98a8-4ca9-a490-f367a6fe292a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090504 Jul 11 16:01:03.166536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 989/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:03.801351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:01:03.802870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:03.813854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.814585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:03.815825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.816599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:03.900694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-315623ec-fb5d-4e79-b12a-7b0176a4cbe8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action" status: 200 len: 82474 microversion: 2.1 time: 0.105543 Jul 11 16:01:03.901343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 998/1987] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 16:01:03 2022] POST /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/action => generated 82474 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:01:03.916841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:03.917510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:03.927114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.927709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:03.928901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:03.929384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:04.184393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:04.185080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:04.192377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:04.192832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:04.193612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:04.194038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:04.258039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:04.266067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-159a625d-b5a7-49e3-b593-f964bb87cb0e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085991 Jul 11 16:01:04.266625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 999/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:05.284468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:05.285268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:05.292829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:05.293271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:05.294020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:05.294459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:05.358708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:05.366927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4b891e45-8f72-427c-bbf4-e55210fd1d74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087063 Jul 11 16:01:05.367820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1000/1989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:06.388395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:06.389436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:06.399614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:06.400065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:06.400866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:06.401297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:06.472683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:06.480519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c6210458-6636-413a-a157-95b344cd0500 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098812 Jul 11 16:01:06.481076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1001/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:07.501713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:07.502846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:07.511434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:07.511886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:07.512690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:07.513127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:07.596554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:07.606636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f25435c-460c-4404-bf13-2b3622a77ef1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.111609 Jul 11 16:01:07.607199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1002/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:08.629760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:08.630818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:08.641803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:08.642529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:08.643779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:08.644531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:08.707224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:08.715210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45818462-f92e-4795-aa62-097441f53167 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091931 Jul 11 16:01:08.715777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1003/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:09.735918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:09.737040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:09.748133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:09.748928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:09.750170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:09.751045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:09.819998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:09.828171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ebbd5759-539d-4367-86a0-2aca0d6a64a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098708 Jul 11 16:01:09.828781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1004/1993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:10.850258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:10.851380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:10.863255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:10.864081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:10.865921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:10.866603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:10.930193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:10.933853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:10.938796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4cc83a4-cf7a-42ce-8428-e3addd594f52 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095377 Jul 11 16:01:10.939346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1005/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:11.958076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:11.959028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:11.968946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:11.969584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:11.970697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:11.971295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:12.037011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:12.045177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-91b1e122-de2c-47c6-842f-7607f05e6c48 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093041 Jul 11 16:01:12.045777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1006/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:13.065093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:13.066039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:13.076617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:13.077198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:13.078387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:13.078983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:13.153110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:13.160911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c025e3a1-29c4-43a9-af96-216fd1562df8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102251 Jul 11 16:01:13.161500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1007/1996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:13.922964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=47 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:13.947594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=70 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:14.182435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:14.183224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:14.194131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:14.194374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:14.196244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:14.196738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:14.263134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:14.275429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-612781c0-7ad7-4941-8122-8ba0a9f505d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099574 Jul 11 16:01:14.276155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1008/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:15.296415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:15.297569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:15.308566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:15.309128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:15.310256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:15.310834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:15.381784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:15.389982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdb52462-43c9-43ad-b4d1-8a3acfdb75d5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100152 Jul 11 16:01:15.390553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1009/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:16.414378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:16.415667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:16.426374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:16.427113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:16.428371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:16.429106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:16.507934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:16.516120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa7a1992-9479-499f-b3aa-c359ef7e46b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.108560 Jul 11 16:01:16.516756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1010/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:17.538417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:17.539495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:17.547495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:17.547940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:17.548752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:17.549176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:17.614204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:17.622525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47f345da-75d6-4858-8601-812c100545d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090848 Jul 11 16:01:17.623085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1011/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:18.644335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:18.645442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:18.654524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:18.654968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:18.655728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:18.656170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:18.721289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:18.729733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0767f59c-893c-4a7f-b063-3d777777b057 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091818 Jul 11 16:01:18.730298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1012/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:19.750747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:19.751830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:19.761617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:19.762065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:19.762835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:19.763268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:19.824941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:19.833394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ea1a5062-87e9-4a9d-887c-4f39a343cc2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089212 Jul 11 16:01:19.833957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1013/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:20.859402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:20.860553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:20.871184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:20.871675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:20.872497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:20.872927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:20.946708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:20.959519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e1b416e0-c102-4765-a57a-a4a669e754cf tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.105699 Jul 11 16:01:20.960363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1014/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:01:21.980390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:21.981151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:21.988340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:21.988852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:21.989659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:21.990118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:22.060146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:22.067954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b692d17-c26f-4437-ab33-e9edda311d64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093389 Jul 11 16:01:22.068556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1015/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:23.086673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:23.087381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:23.094365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:23.094814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:23.095576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:23.096011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:23.160850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:23.168974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-543bdb29-8ac8-45ee-a36e-aecabe42c4e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087272 Jul 11 16:01:23.169539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1016/2005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:24.189001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:24.190488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:24.200203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:24.200688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:24.201461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:24.201895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:24.263723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:24.271456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47fc8e4b-0d2a-45f9-b433-f98e5a0ea55e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088519 Jul 11 16:01:24.272036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1017/2006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:25.293554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:25.294590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:25.305396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:25.306129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:25.307254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:25.307681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:25.376523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:25.384189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c2ac8fea-da70-4a97-855c-f4e32a987d28 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097548 Jul 11 16:01:25.385065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1018/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:26.405131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:26.406151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:26.417092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:26.417861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:26.418646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:26.419111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:26.483464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:26.491506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-79fda334-7694-49b2-86c3-f6e9490ec274 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093014 Jul 11 16:01:26.492070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1019/2008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:27.513306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:27.514346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:27.517761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=60 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:27.526485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:27.526934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:27.527691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:27.528113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:27.602952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:27.611209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ea290930-5064-447e-af51-f368277a60a3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.104563 Jul 11 16:01:27.611782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1020/2009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:28.629177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:28.630127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:28.638770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:28.639221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:28.639987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:28.640458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:28.714347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:28.722392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7f01247-45ff-4527-b21c-6b9a727c6c8b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097792 Jul 11 16:01:28.722962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1021/2010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:01:29.746352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:29.747149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:29.754257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:29.754695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:29.755557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:29.756000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:29.777258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:29.822293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:29.830457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ae299934-81a2-4c64-b363-aaea82c0b694 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090957 Jul 11 16:01:29.831027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1022/2011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:01:30.851270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:30.852269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:30.860847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:30.861302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:30.862063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:30.862495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:30.926404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:30.934565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c64c1823-ea9e-4f9b-9922-0b45806f7e9f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089609 Jul 11 16:01:30.935131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1023/2012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:31.955154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:31.956278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:31.966778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:31.967219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:31.967969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:31.968431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:32.042977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:32.050949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-620b5ffe-8a19-4b36-b268-6491f52f6c38 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102453 Jul 11 16:01:32.051487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1024/2013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:33.068428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:33.069189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:33.076789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:33.077243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:33.078452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:33.079159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:33.400194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:33.409840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7270a326-13c9-4d82-99b5-c227faf9f585 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.345583 Jul 11 16:01:33.410405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1025/2014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:34.431198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:34.432180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:34.439977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:34.440463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:34.441224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:34.441663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:34.506121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:34.514518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6512154-6706-4bcb-8ac6-3884d2017656 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090101 Jul 11 16:01:34.515134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1026/2015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:35.532910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:35.533619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:35.541281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:35.541779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:35.542621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:35.543122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:35.606865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:35.614684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3bb94436-191f-4d6d-a8a3-3185f3ef8eae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086425 Jul 11 16:01:35.615266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1027/2016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:36.636923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:36.638004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:36.648977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:36.649710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:36.650949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:36.651654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:36.732045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:36.740057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b88aeaf2-1b0b-4786-9d00-e6331770342b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.109828 Jul 11 16:01:36.740653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1028/2017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:36.804268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:01:36.805103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:01:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3 (ip 10.222.0.26) !!! Jul 11 16:01:37.765728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:37.766596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:37.776947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:37.777636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:37.778796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:37.779436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:37.848705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:37.856992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0247c3f0-5e4c-4b1d-835e-6715c9d1cf61 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097556 Jul 11 16:01:37.857578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1029/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:38.881359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:38.882120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:38.892189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:38.892845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:38.894002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:38.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:38.959357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:38.967918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-60997313-91a0-4b20-bbd1-663b4e774cf3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092771 Jul 11 16:01:38.968514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1030/2019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:39.985387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:39.986134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:39.992973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:39.993423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:39.994180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:39.994609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:40.063090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:40.070984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0fe0bab-9f31-4064-b8d5-107264059589 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089729 Jul 11 16:01:40.071567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1031/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:39 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:41.092674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:41.093882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:41.104603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:41.105361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:41.106620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:41.107330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:41.171492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:41.179344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a2fa0577-e68b-4fd4-a8d2-460ea3dcda5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093432 Jul 11 16:01:41.179908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1032/2021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:42.200168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:42.201322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:42.208990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:42.209432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:42.210156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:42.210603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:42.275562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:42.283853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e7fcdb22-8690-486c-9532-c2cdb0ca0338 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090142 Jul 11 16:01:42.284451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1033/2022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:01:43.305109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:43.306164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:43.318103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:43.318855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:43.320162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:43.320967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:43.387148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:43.395468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b981c6c8-23bc-466c-85e2-fd8fc6eb1c72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097361 Jul 11 16:01:43.396035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1034/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:44.417011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:44.418056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:44.429835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:44.430659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:44.431941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:44.432663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:44.498345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:44.507681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-14eaf8af-12fb-415e-833b-d3be69c6eaaa tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097613 Jul 11 16:01:44.508266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1035/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:45.529256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:45.530375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:45.540987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:45.541718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:45.543143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:45.543896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:45.606317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:45.614966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f69ca5a6-fe5b-47b0-86c9-caf9a0fad6c7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092115 Jul 11 16:01:45.615554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1036/2025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:46.704506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:46.705117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:46.711289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.711725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:46.712500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.712922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:46.731360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lazy-loading 'services' on Instance uuid 16771e46-eae0-460a-9353-dbcfdb1338d1 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:01:46.778814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:46.786291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f0c15f3d-802a-423f-8e60-62218a1db890 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.155244 Jul 11 16:01:46.786821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1037/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:46 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:46.791298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:46.791865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:46.797581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.798193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:46.798991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.799418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:46.823356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:01:46.836894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:46.908621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab9e0fcc-183a-42a4-96f2-edf918cc7be7 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 204 len: 0 microversion: 2.1 time: 0.120413 Jul 11 16:01:46.909222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1038/2027] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:01:46 2022] DELETE /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:01:46.915395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:46.916103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:46.923460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.923898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:46.924709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:46.925140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:47.530824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Request method failure captured: Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3 HTTP/1.1 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEc4_rg_N-rGB1UiQqC-zXIgi50w9ygAoM6V-tub_SSgioOII-iK5vICo12r7zik2RkUxLzZi7HnhNwyhUnbvFLSQH2b8ZZEhdJ4sb-BU7YGAyIo73iiOQ8XTHt1CKTbtiX6gRo9gPNqI-M1-NpmMOB4wloZZGq893ortcDoKP86QEM Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: e28a535e7b6044daa85fa92c799f6069 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-TestMinimumBasicScenario-112363638 Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:01:47.533353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e28a535e7b6044daa85fa92c799f6069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e28a535e7b6044daa85fa92c799f6069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e28a535e7b6044daa85fa92c799f6069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e28a535e7b6044daa85fa92c799f6069"}]}] Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-TestMinimumBasicScenario-112363638 Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: e28a535e7b6044daa85fa92c799f6069 Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-TestMinimumBasicScenario-112363638 Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-TestMinimumBasicScenario-112363638-project Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 726afc5bae8a405bb182f9ed67122d3c Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-TestMinimumBasicScenario-112363638-project Jul 11 16:01:47.535814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'server_id': '16771e46-eae0-460a-9353-dbcfdb1338d1', 'id': '86302ded-f409-4874-b1b4-bc671f60eea3'} Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:01:47.539119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:01:47.542602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:47.545376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:01:47.547904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) Jul 11 16:01:47.550494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:47.552783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-547956fb-8dea-46d8-a04f-5b16638bb81e) {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:01:47.552783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dafdfab3-b551-4929-a5ef-a0840f2d7af3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3" status: 400 len: 269 microversion: 2.1 time: 43.625891 Jul 11 16:01:47.552783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 990/2028] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:01:03 2022] DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1/os-volume_attachments/86302ded-f409-4874-b1b4-bc671f60eea3 => generated 269 bytes in 43628 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:01:47.552783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:47.553666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:47.556200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:47.556803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:47.557738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:47.558251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:47.589555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 88cc8ab2-ba6d-49ba-af09-a265ba22234a {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:01:47.690169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:47.698208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a9fd8ec0-7aee-44df-87be-9fb8cc71033d tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1673 microversion: 2.1 time: 0.159644 Jul 11 16:01:47.698768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 991/2029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:47 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:47.803568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:47.804229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:47.810746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:47.811202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:47.812106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:47.812475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:47.877074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:47.885254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ed2eff42-322b-4177-93b8-d33035dccd5a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085799 Jul 11 16:01:47.885950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 992/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:48.278908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-00b82e9f-61c3-42aa-9c17-5389d9957749 req-79ce48be-7cca-4f3f-9562-bdbdd40bf55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6fcee3-9b96-4b38-b57e-114c6778e58a", "name": "network-vif-deleted", "tag": "79bbf21a-ab7c-4406-9e24-a2fadd5b3254"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:01:48.291019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-00b82e9f-61c3-42aa-9c17-5389d9957749 req-79ce48be-7cca-4f3f-9562-bdbdd40bf55c service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.291895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-00b82e9f-61c3-42aa-9c17-5389d9957749 req-79ce48be-7cca-4f3f-9562-bdbdd40bf55c service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.319236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-00b82e9f-61c3-42aa-9c17-5389d9957749 req-79ce48be-7cca-4f3f-9562-bdbdd40bf55c service nova] Creating event network-vif-deleted:79bbf21a-ab7c-4406-9e24-a2fadd5b3254 for instance af6fcee3-9b96-4b38-b57e-114c6778e58a on hv-cinder-79760 Jul 11 16:01:48.328909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-00b82e9f-61c3-42aa-9c17-5389d9957749 req-79ce48be-7cca-4f3f-9562-bdbdd40bf55c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136384 Jul 11 16:01:48.330219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 993/2031] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:01:48.717399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:48.718341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:48.725671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.726343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.727190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.727703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.760558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.761117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.761577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lazy-loading 'fault' on Instance uuid af6fcee3-9b96-4b38-b57e-114c6778e58a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:01:48.806533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052b95d2857c4e728a8008d00fc34780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6145a3ef3d147afbeb90dd49d01af2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:48.814695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6efa8c6a-41dc-4daf-960b-0a1bf3f5b9d1 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 200 len: 1328 microversion: 2.1 time: 0.101634 Jul 11 16:01:48.815275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 994/2032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:48 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:48.902411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:48.903101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:48.910365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.910875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.911652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:48.912101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:48.979428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:48.989795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2600675b-eb95-4c76-a0fa-749e6558fc34 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091187 Jul 11 16:01:48.992453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 995/2033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:49.836747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:49.837835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:49.848828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:49.849574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:49.850842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:49.851558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:49.868871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a HTTP/1.1 Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:01:49.870513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:01:49.872014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'af6fcee3-9b96-4b38-b57e-114c6778e58a'} Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:01:49.872884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:01:49.874183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:01:49.875336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:01:49.875336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d1dd5b8d-2e40-48f1-b0ad-54335b3960df tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 404 len: 111 microversion: 2.1 time: 0.042230 Jul 11 16:01:49.875336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 996/2034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:49 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:01:49.880700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ba2e5daa-5519-429a-9fca-c2136d46acd3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '.version_select at 0x7f20bbc9cb80>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:49.907668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ba2e5daa-5519-429a-9fca-c2136d46acd3 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527143253" status: 202 len: 0 microversion: 2.1 time: 0.030459 Jul 11 16:01:49.908224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 997/2035] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 16:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527143253 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:01:50.007145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:50.007773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:50.014141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:50.014590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:50.015660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:50.016401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:50.095916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:50.105801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5cb5f3c-779e-46ff-852c-9eb9b5bf9544 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.102897 Jul 11 16:01:50.106550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 998/2036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:50 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:51.123467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:51.124175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:51.131684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:51.132147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:51.132990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:51.133434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:51.200811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:51.210372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-baf60d68-f2a7-412d-b21e-9b165fcf5b21 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091008 Jul 11 16:01:51.210971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 999/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:52.228322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:52.229295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:52.236836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:52.237289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:52.238057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:52.238497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:52.305681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:52.313920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3a6b27dd-6a99-4599-ae32-97d80b775ee6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089530 Jul 11 16:01:52.314494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1000/2038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:53.335865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:53.336692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:53.345611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:53.346064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:53.346834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:53.347269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:53.417309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:53.425630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93041cd3-36d2-45e3-953f-231b08511cae tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097810 Jul 11 16:01:53.426215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1001/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:54.447233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:54.448337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:54.458039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:54.458489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:54.459255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:54.459886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:54.531178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:54.539809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b4a730c-6562-413f-899a-6e20006f3ab5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099241 Jul 11 16:01:54.540380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1002/2040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:55.560488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:55.561282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:55.571812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:55.572268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:55.573477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:55.574156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:55.656043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:55.665159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6a580112-1897-4ceb-ad10-d96e80473dce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.111219 Jul 11 16:01:55.665758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1003/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:56.688186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:56.689286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:56.698346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:56.698899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:56.699680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:56.700122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:56.775229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:56.785047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ff4769b-b5cd-468e-ab07-114a4ca0cb11 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103410 Jul 11 16:01:56.785656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1004/2042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:56.921087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:57.596856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:57.802971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:57.803577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:57.810810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:57.811254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:57.812011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:57.812478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:57.885008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:57.894965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2d745ef8-108f-4845-8ed2-79d185d79237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095970 Jul 11 16:01:57.895715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1005/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:01:58.919339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:01:58.919964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:01:58.929646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:58.930306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:58.931391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:01:58.931855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:01:58.996795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:01:59.008268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73b03faa-2ef0-4878-9480-bdf7d712ff75 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094068 Jul 11 16:01:59.009228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1006/2044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:01:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:00.035711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:00.036752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:00.045369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:00.045821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:00.046668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:00.047094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:00.109404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:00.117150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-56e06582-c6c6-43a7-9f80-de925780b21a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088337 Jul 11 16:02:00.117707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1007/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:00 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:01.138419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:01.139510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:01.150230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:01.150684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:01.151452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:01.151887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:01.227604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:01.231262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:01.236636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-01ccf448-b202-4c43-9217-43522a02aa2b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.104985 Jul 11 16:02:01.237196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1008/2046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:02.255443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:02.256248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:02.263565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:02.264011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:02.264810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:02.265240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:02.326852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:02.335119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8a73b9b1-dc40-4994-83c7-58c9365600b8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085135 Jul 11 16:02:02.335683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1009/2047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:03.356734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:03.357732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:03.368682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:03.369107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:03.369883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:03.370312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:03.446898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:03.459884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-de2d208a-a3ab-40c6-a2d6-ad3e038fed62 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.109831 Jul 11 16:02:03.460762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1010/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:04.485034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:04.485743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:04.495767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:04.496425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:04.497566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:04.498210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:04.566651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:04.574723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1561025-1043-4491-86ab-ab9b57676596 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095762 Jul 11 16:02:04.575295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1011/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:05.592477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:05.593279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:05.602692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:05.604042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:05.605262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:05.605909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:05.678560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:05.687646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39354b6e-ed85-4cc0-b4af-0a6712dc9c8a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099893 Jul 11 16:02:05.688234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1012/2050] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:06.708462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:06.709621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:06.720791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:06.721553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:06.723258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:06.723987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:06.797857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:06.809860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8675cc7c-a400-408e-bcbf-aa221da8e6fc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.107965 Jul 11 16:02:06.810563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1013/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:07.831081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:07.832540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:07.841080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:07.841527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:07.842282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:07.842712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:07.910973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:07.918818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-24ffa06a-ecc1-4c1d-a3dc-133237a98a72 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094279 Jul 11 16:02:07.919396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1014/2052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:08.939951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:08.941202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:08.949988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:08.950447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:08.951212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:08.951652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:09.020741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:09.028783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e48cabcb-c40b-4d8b-9fa7-06b61e7a23b5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095311 Jul 11 16:02:09.029353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1015/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:10.049843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:10.050952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:10.061585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:10.062201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:10.063353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:10.063944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:10.137382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:10.145126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4f1f7d9-7219-4b96-bced-fea926fcbad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101883 Jul 11 16:02:10.145730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1016/2054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:10 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:11.167376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:11.168552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:11.179260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:11.180008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:11.181221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:11.181662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:11.256722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:11.264592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0f381ecb-aea2-4531-b9c1-e85ce30e74a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103959 Jul 11 16:02:11.265140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1017/2055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:12.285512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:12.286560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:12.294797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:12.295241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:12.295994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:12.296460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:12.368621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:12.379146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b9fdeb70-364f-41bf-914d-8aa40cdb3662 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099761 Jul 11 16:02:12.379773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1018/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:13.400145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:13.401408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:13.408929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:13.409431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:13.410276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:13.410762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:13.485684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:13.496674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b096805-bb3c-4658-821b-ee76ab13f30a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103112 Jul 11 16:02:13.497256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1019/2057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:14.516003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:14.517140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:14.519960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:14.527594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:14.528066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:14.528875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:14.529310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:14.596440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:14.604608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e0873c13-73d5-463e-943f-7673441fd8d6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093400 Jul 11 16:02:14.605182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1020/2058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:15.622462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:15.623150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:15.630024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:15.630484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:15.631255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:15.631685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:15.695494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:15.703454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-005219cb-7a81-4b9c-a485-45346b922503 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.085239 Jul 11 16:02:15.704040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1021/2059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:16.728345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:16.729421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:16.736915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:16.737359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:16.738113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:16.738539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:16.804914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:16.812786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ccc1dcb8-5ce6-456c-81f6-55093c46817a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090919 Jul 11 16:02:16.813353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1022/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:17.834087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:17.835180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:17.843706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:17.844155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:17.844954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:17.845396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:17.906816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:17.914498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2a30a895-9e92-4429-becb-166cf3fcc7d9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087392 Jul 11 16:02:17.915063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1023/2061] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:18.936121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:18.937280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:18.947848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:18.948659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:18.949837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:18.950277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:19.017011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:19.028799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-41a92fa6-1fc4-4444-9344-c09f3e11dc83 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099109 Jul 11 16:02:19.029712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1024/2062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:20.054874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:20.055957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:20.064063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:20.064549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:20.065312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:20.065743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:20.086818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:20.132055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:20.140776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d5f1cc3-d482-4a66-86ee-19cf0ce6c8ad tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092161 Jul 11 16:02:20.141328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1025/2063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:20 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:21.163042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:21.164117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:21.172716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:21.173161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:21.173918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:21.174348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:21.245058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:21.253077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-70223ed8-19c8-4495-9e2c-3496aae017e1 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096700 Jul 11 16:02:21.253641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1026/2064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:22.273210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:22.274328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:22.282190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:22.282633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:22.283386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:22.283815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:22.346081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:22.353886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8e7f3163-3c9e-4301-a0df-ce0883396afb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087183 Jul 11 16:02:22.354453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1027/2065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:23.381429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:23.382548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:23.391005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:23.391452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:23.392214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:23.392676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:23.458717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:23.466827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2235d899-7afb-43e3-a411-7770a04bb2ca tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092251 Jul 11 16:02:23.467402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1028/2066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:24.484918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:24.485650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:24.493193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:24.493692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:24.494539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:24.495018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:24.568325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:24.576558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cc28f6c2-a80e-4c68-90f9-6f3f523f95ff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096244 Jul 11 16:02:24.577125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1029/2067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:25.603023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:25.604142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:25.615055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:25.615769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:25.617227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:25.617951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:25.682614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:25.690360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c8e1dc9-ef8a-4776-b27c-9a43c37dcdbd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093927 Jul 11 16:02:25.690935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1030/2068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:02:26.720032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:26.721136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:26.731711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:26.732195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:26.732995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:26.733442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:26.799183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:26.807450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ddb7f136-ad52-4e69-8b2b-dd8a590f60b4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093896 Jul 11 16:02:26.808026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1031/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:27.829058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:27.830174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:27.841003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:27.841450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:27.842237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:27.842671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:27.908764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:27.916825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e2ab330-37c9-4fe7-af5d-c0c43c05d6cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094610 Jul 11 16:02:27.917390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1032/2070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:28.938609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:28.939714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:28.950555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:28.951006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:28.951780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:28.952241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:29.019780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:29.028091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a43f076-acec-49b2-a3c3-cf21bd4f6bb8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096079 Jul 11 16:02:29.028701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1033/2071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:30.052847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:30.053890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:30.062847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:30.063297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:30.064091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:30.064555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:30.131323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:30.139684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d0e070bc-9828-448e-81c1-eac41eef2681 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093432 Jul 11 16:02:30.140260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1034/2072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:02:31.161687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:31.162359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:31.171402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:31.171853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:31.172654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:31.173090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:31.238015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:31.248934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7fdb2ec9-6563-4b27-96bd-4f37db228d39 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094007 Jul 11 16:02:31.249505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1035/2073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:31 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:32.270371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:32.271552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:32.280062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:32.280541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:32.281298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:32.281726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:32.346035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:32.353788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8e3bfedf-6001-4aab-b2ca-835d3d84ad64 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090300 Jul 11 16:02:32.354375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1036/2074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:33.375271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:33.376381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:33.387240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:33.387724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:33.388531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:33.388965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:33.461925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:33.472349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aca91d01-f9cc-416b-99d9-3fef71122dbc tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.103338 Jul 11 16:02:33.473151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1037/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:34.495131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:34.496170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:34.503073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:34.503517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:34.504271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:34.504734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:34.566795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:34.577186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-558d579c-9488-41cb-8f78-0147deca8487 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088354 Jul 11 16:02:34.578243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1038/2076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:35.603758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:35.604913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:35.612135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:35.612623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:35.613386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:35.613821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:35.685764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:35.694094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c076e891-f4a8-4df2-87ad-5fbfdb8c834c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097058 Jul 11 16:02:35.694660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1039/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:36.716206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:36.717085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:36.725565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:36.726131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:36.727082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:36.727624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:36.797269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:36.805270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0bc2d6d3-215f-4704-a137-4bb248795ad6 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095608 Jul 11 16:02:36.805839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1040/2078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:37.825420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:37.826026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:37.833340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:37.833794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:37.834584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:37.835017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:37.900644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:37.908597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-269d4b5b-a771-4764-a005-92c2d74b4c84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088851 Jul 11 16:02:37.909162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1041/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:38.929591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:38.930609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:38.938637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:38.939082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:38.939834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:38.940265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:38.944259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:39.002586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:39.010224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98d7322e-10da-4f83-8e2a-194bfffa0798 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087164 Jul 11 16:02:39.010788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1042/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:40.030927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:40.032069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:40.042949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:40.043393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:40.044157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:40.044622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:40.117201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:40.125392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-690ca1a6-9e05-4d58-a086-741565e8d397 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101026 Jul 11 16:02:40.125953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1043/2081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:41.150605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:41.151723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:41.158845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:41.159300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:41.160069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:41.160546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:41.225451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:41.233397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5810367d-40fd-45c9-8922-9b05bffb2237 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089443 Jul 11 16:02:41.233976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1044/2082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:02:42.254365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:42.255484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:42.264641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:42.265091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:42.265864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:42.266297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:42.331829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:42.340098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fa862895-227b-440a-840e-f5ab8c2452e9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091891 Jul 11 16:02:42.340682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1045/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:43.361718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:43.362817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:43.372767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:43.373219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:43.373987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:43.374420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:43.603032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:43.611490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cc84b839-a8ce-486a-952d-0e7f482662ab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.256574 Jul 11 16:02:43.612058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1046/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:44.632613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:44.633730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:44.637085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=54 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:44.642666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:44.643183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:44.643957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:44.644429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:44.710018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:44.718546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6eadb9d-8da4-4e94-9aa3-74086238a4af tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092417 Jul 11 16:02:44.719110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1047/2085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:45.743845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:45.746558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:45.753399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:45.753843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:45.754563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:45.755051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:45.820082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:02:45.827927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d26b9e86-2c41-4fa9-a128-e6586f76825f tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090610 Jul 11 16:02:45.828497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1048/2086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:02:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:02:46.867166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:02:46.867789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:02:46.876256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:46.876888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:46.877950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:02:46.878501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:02:56.871553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=5 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:56.900520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=44 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:10.409706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:03:10.410610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d (ip 10.222.0.26) !!! Jul 11 16:03:17.294332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:03:17.295033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d (ip 10.222.0.26) !!! Jul 11 16:03:47.067977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a41c2a36-a137-424b-88ce-1010981d8429 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d" status: 202 len: 0 microversion: 2.1 time: 120.157244 Jul 11 16:03:47.068754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1039/2087] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:01:46 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d => generated 0 bytes in 120159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:03:47.074314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:47.075007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:47.081585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.082337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.083460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.083942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.152840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:47.161271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-25ff31f5-7f81-46ce-a7ac-2d8ac0492638 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091546 Jul 11 16:03:47.162085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1040/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:47.166757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:47.167238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:47.173715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.174156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.174977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.175406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.228079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 88cc8ab2-ba6d-49ba-af09-a265ba22234a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:03:47.666757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 88cc8ab2-ba6d-49ba-af09-a265ba22234a {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:03:47.695192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Request method failure captured: Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d HTTP/1.1 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEdNvZy9yflCrMpFp8Osq7uPJLM-7zobldm-wm42W--58q5VwHsniMlEnzA3gxXy0rhD3edYBaR_anfSqMV05IfQGedbf_d3J2NMAkjWnWrTI436QWrvBBRJx6nhjOyaWnGpW_f-daQ-xUaqFsZnd7lz-9PxLrqQhDnz9jzyU1eUk3Q Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:03:47.697496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b09e1a0de62456d90789370bba74b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b09e1a0de62456d90789370bba74b53"}]}] Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 99827ab52d9242f385177cada4335b38 Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:03:47.699051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'server_id': '88cc8ab2-ba6d-49ba-af09-a265ba22234a', 'id': '55f5069b-f17a-4118-8fbc-23dd7f6de61d'} Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:03:47.700087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:03:47.701528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:03:47.702872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:03:47.704474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) Jul 11 16:03:47.705980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:03:47.707617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4314bcea-7030-4380-90c2-c336bb993a70) {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:03:47.707617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-578fe5e7-34dc-4b7b-a97e-7c477e829a78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d" status: 400 len: 269 microversion: 2.1 time: 60.990700 Jul 11 16:03:47.707617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1049/2089] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:02:46 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d => generated 269 bytes in 60993 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:03:47.707617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:47.707975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:47.711742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.712198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.713002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:47.713434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:47.776547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:47.785360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8978d091-ff39-47ad-921c-ab9456a1740b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.084691 Jul 11 16:03:47.785911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1050/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:48.807271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:48.808400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:48.819496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:48.820250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:48.821569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:48.822303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:48.889448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:48.897778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-36346d58-0b58-4722-8ca2-d5c976d8e9f7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097075 Jul 11 16:03:48.898338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1051/2091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:49.923227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:49.924388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:49.935398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:49.936134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:49.937478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:49.938313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:50.005732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:50.017966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d5c81450-1323-4815-ad40-feeff8a576cd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101109 Jul 11 16:03:50.018878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1052/2092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:49 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:51.039761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:51.040488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:51.047740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:51.048711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:51.049493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:51.049952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:51.123723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:51.131770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2fccdf3b-4c90-45c9-a453-34fd8d73751a tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095916 Jul 11 16:03:51.132350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1053/2093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:51 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:52.152935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:52.154063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:52.162138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:52.162590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:52.163355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:52.163794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:52.233533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:52.241262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-01fb7bf2-5c37-4693-9d5d-b378b86f3d00 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095002 Jul 11 16:03:52.241822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1054/2094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:52 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:53.262416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:53.263407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:53.271482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:53.271936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:53.272746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:53.273183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:53.337762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:53.345834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-84a94958-263f-4eec-b8a1-a7b79e6133b7 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089988 Jul 11 16:03:53.346405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1055/2095] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:53 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:54.367051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:54.368191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:54.377987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:54.378458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:54.379240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:54.379675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:54.444166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:54.452368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-544d0e15-6952-4d8e-90ce-076f41443864 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092266 Jul 11 16:03:54.452869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1056/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:54 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:55.473662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:55.474699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:55.485787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:55.486243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:55.487001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:55.487442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:55.547776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:55.555595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-684b7e31-f937-4bbc-86de-32d92c35d4a9 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088778 Jul 11 16:03:55.556162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1057/2097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:55 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:56.576973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:56.577658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:56.588141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:56.588841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:56.589967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:56.590623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:56.653911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:56.661720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-952229f1-55e0-4621-b691-8b5097a30f07 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091411 Jul 11 16:03:56.662285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1058/2098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:56 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:57.172111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:57.670949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:57.679957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:57.680600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:57.689932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:57.690379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:57.691349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:57.691893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:57.768126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:57.777923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0f315f24-af79-46a6-ad91-7c59af63c112 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101894 Jul 11 16:03:57.778494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1059/2099] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:57 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:58.804344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:58.805415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:58.815795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:58.816237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:58.817020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:58.817448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:58.884475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:03:58.895166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7dd291e5-2922-47d6-bfba-63929e0dcfcb tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097546 Jul 11 16:03:58.895858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1060/2100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:58 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:03:59.916732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:03:59.917785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:03:59.927077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:59.927529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:59.928285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:03:59.928757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:03:59.995058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:00.006988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6a503aaa-1c9e-4d74-ae17-d9f154f6d1c5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096494 Jul 11 16:04:00.007723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1061/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:03:59 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:01.032110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:01.033631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:01.040130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:01.040617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:01.041376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:01.041793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:01.104466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:01.112157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d9184cb-9e2f-45d5-b2c7-8025aa113917 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086645 Jul 11 16:04:01.112755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1062/2102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:01 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:02.139220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:02.140512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:02.147994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:02.148477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:02.149244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:02.149679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:02.218418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:02.226254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-19181e01-ceb9-4fc8-b807-b68611aa59d4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093811 Jul 11 16:04:02.226736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1063/2103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:02 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:03.246363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:03.247464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:03.257863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:03.258558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:03.259721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:03.260444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:03.328189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:03.336324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-38c72479-bba6-4122-9f24-2447f42a7724 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096113 Jul 11 16:04:03.336912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1064/2104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:03 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:04.357455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:04.358576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:04.370030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:04.373032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:04.373032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:04.373032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:04.437956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:04.442967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:04.449844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6f460a61-0727-4a31-9fad-8f357a142353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098790 Jul 11 16:04:04.450637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1065/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:04 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:05.473512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:05.474530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:05.485243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:05.485982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:05.487189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:05.487616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:05.550733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:05.561872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3225e032-27e4-487a-9d56-30fc9c73b6d3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095423 Jul 11 16:04:05.562627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1066/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:05 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:06.584173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:06.585274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:06.596265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:06.596747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:06.597525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:06.597964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:06.670323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:06.678533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b72f01ba-7ca4-4e96-8506-e64d79dcd938 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101308 Jul 11 16:04:06.679105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1067/2107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:06 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:07.698453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:07.699309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:07.708328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:07.708803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:07.709562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:07.710002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:07.779418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:07.789019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9472ee58-e462-4cf7-9307-f607e12e8e56 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.096506 Jul 11 16:04:07.789586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1068/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:07 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:08.809681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:08.810699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:08.819280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:08.819728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:08.820530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:08.820948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:08.892764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:08.900706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c6295ee-414b-4dda-8043-c68f57d5e4e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097467 Jul 11 16:04:08.901396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1069/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:08 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:09.921893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:09.923067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:09.931496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:09.931946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:09.932740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:09.933178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:09.994938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:10.002612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e9821359-5f73-4af6-9e49-e3c18ba1a4c0 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087371 Jul 11 16:04:10.003175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1070/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:09 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:11.024846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:11.025863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:11.036846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:11.037305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:11.038174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:11.038509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:11.107596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:11.116117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e54945d-292f-46f0-a8f0-948f84af0078 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.098166 Jul 11 16:04:11.116719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1071/2111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:11 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:12.135491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:12.136547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:12.145271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:12.146025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:12.146812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:12.147236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:12.220644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:12.229847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f26ef3bb-7cd1-4799-8d6c-63cdffb5fcc3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099648 Jul 11 16:04:12.230429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1072/2112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:12 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:13.247473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:13.248089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:13.255233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:13.255894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:13.256595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:13.257027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:13.330831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:13.340525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ed09d8c-6b3d-4bad-946f-68afb03d59e2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097017 Jul 11 16:04:13.341098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1073/2113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:13 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:14.357964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:14.358605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:14.365571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:14.366021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:14.366787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:14.367222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:14.437517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:14.448652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-558610d1-fa68-40e8-b675-9154e499b7b3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094556 Jul 11 16:04:14.449844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1074/2114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:14 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:15.473077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:15.473751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:15.481119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:15.481697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:15.482466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:15.482903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:15.546004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:15.554429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-efa35cf6-8fa0-4580-bfdb-267cccd9ed93 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.086885 Jul 11 16:04:15.555062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1075/2115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:15 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:16.573644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:16.574347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:16.583817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:16.584283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:16.585088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:16.585521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:16.660236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:16.668386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b251973-b247-40f7-942f-ca30eac047e5 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100136 Jul 11 16:04:16.668966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1076/2116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:16 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:17.687556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:17.688495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:17.691569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=55 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:17.697856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:17.698310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:17.699074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:17.699515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:17.766421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:17.776241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c25cd57-866e-4057-b8ba-ccd32dd27241 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093772 Jul 11 16:04:17.776976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1077/2117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:17 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:18.798026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:18.799019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:18.808981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:18.809567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:18.810742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:18.811461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:18.884704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:18.892543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-663b71bb-58db-41df-84ba-e66cc9683377 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099978 Jul 11 16:04:18.893116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1078/2118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:18 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:19.914303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:19.915022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:19.922017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:19.922476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:19.923244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:19.923679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:19.994056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:20.001834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83c89914-4178-4914-84cc-414a0ae1dc84 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093780 Jul 11 16:04:20.002407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1079/2119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:19 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:21.020354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:21.021634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:21.028814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:21.029265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:21.030027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:21.030468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:21.106357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:21.113998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ad06a1a6-3a83-42fa-9810-420189298eab tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097614 Jul 11 16:04:21.114609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1080/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:21 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:22.134650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:22.135375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:22.145879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:22.146324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:22.147120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:22.147556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:22.213256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:22.220974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c1cb368a-e258-4caa-b8ab-f9fb7a0aa17b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092423 Jul 11 16:04:22.221541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1081/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:22 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:23.238275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:23.238935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:23.246168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:23.246614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:23.247360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:23.247790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:23.266069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:23.320099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:23.328049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-76ca43b1-f47f-4362-8fc4-5a15219afbff tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.093699 Jul 11 16:04:23.328653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1082/2122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:23 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:24.347949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:24.349168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:24.357638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:24.358383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:24.359623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:24.360340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:24.423365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:24.431053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2b5befc4-aca5-41f6-b757-dbc07e1d827c tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.087352 Jul 11 16:04:24.431590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1083/2123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:24 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:25.448806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:25.449582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:25.457753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:25.458322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:25.459194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:25.459703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:25.531464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:25.539618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac80ac4f-901f-48b2-ac00-79bc650f392e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095562 Jul 11 16:04:25.540206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1084/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:25 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:26.563694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:26.564375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:26.572828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:26.573418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:26.574616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:26.575234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:26.650195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:26.658293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54cafdce-c3c0-496c-99d7-5fc23bd181d2 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.100603 Jul 11 16:04:26.658873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1085/2125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:26 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:04:27.677647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:27.678449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:27.687342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:27.687927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:27.689028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:27.689609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:27.755447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:27.763248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf1886e2-8974-4452-8d91-fe253fd928ce tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091154 Jul 11 16:04:27.763839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1086/2126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:27 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:28.787166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:28.787881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:28.794796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:28.795259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:28.796021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:28.796508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:28.860927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:28.873107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0f685fd0-a8e9-492e-9868-bac6561ebb3e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090775 Jul 11 16:04:28.873803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1087/2127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:28 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:29.896441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:29.897139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:29.904322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:29.904803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:29.905568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:29.905999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:29.979285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:29.987253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f1f59693-1796-4b33-82bb-45918c745734 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097397 Jul 11 16:04:29.987798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1088/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:29 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:31.004596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:31.005506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:31.012319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:31.012792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:31.013561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:31.014000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:31.086065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:31.098707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-851660a3-ef95-4f4c-977b-11a923ac3579 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097808 Jul 11 16:04:31.099338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1089/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:30 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:32.117198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:32.117918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:32.124200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:32.124689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:32.125482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:32.125947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:32.194370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:32.202384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-572327e4-c622-4afd-bbc0-7ce26e3d8190 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.090016 Jul 11 16:04:32.202959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1090/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:32 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:33.220108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:33.220772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:33.229624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:33.230294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:33.231263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:33.231829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:33.297457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:33.305759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54863270-0981-47d2-8db3-420492280fe3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.089596 Jul 11 16:04:33.306337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1091/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:33 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:34.322825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:34.323526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:34.330325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:34.330776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:34.331543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:34.332282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:34.397188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:34.408021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f5921533-953c-41ca-86be-e516831f3121 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.088876 Jul 11 16:04:34.408782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1092/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:34 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:35.427896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:35.428640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:35.435233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:35.435687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:35.436469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:35.436904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:35.505992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:35.513873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6a3412eb-0ec4-4aec-889d-b882f9804b37 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092014 Jul 11 16:04:35.514441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1093/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:35 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:35.692442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:04:35.692442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:04:36.535687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:36.537548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:36.543122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:36.543600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:36.544315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:36.544790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:36.796137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:36.804200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8564caa0-8813-4273-9f64-024fc198f3d8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.275312 Jul 11 16:04:36.804795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1094/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:36 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:37.825606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:37.826409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:37.835057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:37.835577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:37.836513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:37.837004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:37.905414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:37.913755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3cdf7b5a-6856-4108-bc13-fb34a07cc1e3 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.092734 Jul 11 16:04:37.914483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1095/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:37 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:38.933244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:38.934066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:38.942621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:38.943183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:38.944117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:38.944697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:39.028573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:39.036761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a4411e7-7a80-4876-b712-1d3dffd43067 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.108441 Jul 11 16:04:39.037320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1096/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:38 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:40.058238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:40.059257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:40.069335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:40.069790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:40.070553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:40.070994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:40.143659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:40.153281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b2c2bc4e-6767-4319-ad37-5e2725f066a4 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.101745 Jul 11 16:04:40.153847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1097/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:40 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:41.172833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:41.173729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:41.181566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:41.182537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:41.183309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:41.183720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:41.250076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:41.258435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14221336-a6c4-48ba-8a9f-cb06652c4c03 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.091717 Jul 11 16:04:41.258989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1098/2138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:41 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:42.283505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:42.284516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:42.292218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:42.292704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:42.293473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:42.293893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:42.297974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:42.366515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:42.374641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc630919-d8ec-4d9d-b523-8f4cd2dc3c74 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.097209 Jul 11 16:04:42.375209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1099/2139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:42 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:43.394305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:43.395035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:43.402406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:43.402858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:43.403612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:43.404049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:43.477205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:43.484855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a9b1089-25bc-4a99-a71a-6b3b6ca6850b tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094894 Jul 11 16:04:43.485422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1100/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:43 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:04:44.506436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:44.507096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:44.513881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:44.514324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:44.515083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:44.515513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:44.587475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:44.595801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f4f76789-5fad-40a6-a986-e46774d7a5df tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.095924 Jul 11 16:04:44.596361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1101/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:44 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:45.618253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:45.619503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:45.630356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:45.631097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:45.632501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:45.633060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:45.709605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:45.722767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b363f82-9170-46f1-b426-272a4d732353 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.111528 Jul 11 16:04:45.723626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1102/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:45 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:46.742006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:46.742824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:46.750439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:46.750962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:46.751794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:46.752331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:46.823750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:04:46.831650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7760ff9-cb4f-4657-b783-afc4bb7a0ad8 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.094155 Jul 11 16:04:46.832571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1103/2143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:04:46 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:04:46.837220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:04:46.837698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:04:46.843425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:46.843868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:46.844641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:04:46.845072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:04:56.817995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:04:56.819089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d (ip 10.222.0.26) !!! Jul 11 16:04:56.841280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=55 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:56.863479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=32 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:47.539700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Request method failure captured: Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d HTTP/1.1 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEdNvZy9yflCrMpFp8Osq7uPJLM-7zobldm-wm42W--58q5VwHsniMlEnzA3gxXy0rhD3edYBaR_anfSqMV05IfQGedbf_d3J2NMAkjWnWrTI436QWrvBBRJx6nhjOyaWnGpW_f-daQ-xUaqFsZnd7lz-9PxLrqQhDnz9jzyU1eUk3Q Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:05:47.542024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b09e1a0de62456d90789370bba74b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b09e1a0de62456d90789370bba74b53"}]}] Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 99827ab52d9242f385177cada4335b38 Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:47.543611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'server_id': '88cc8ab2-ba6d-49ba-af09-a265ba22234a', 'id': '55f5069b-f17a-4118-8fbc-23dd7f6de61d'} Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:47.544582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:47.546388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.547962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:47.549338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) Jul 11 16:05:47.553201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.554496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad89b653-b0f8-42a9-a580-f9a95d97ebe8) {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:05:47.554496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-209c62de-6461-46ec-b315-453b9cdf2921 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d" status: 400 len: 269 microversion: 2.1 time: 120.380514 Jul 11 16:05:47.554496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1041/2144] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:03:47 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d => generated 269 bytes in 120382 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:05:47.554496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:05:47.554814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:05:47.558362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:47.558913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:47.559662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:47.560232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:47.637280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2fbf5d3064479a909e7547a050ef5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34616afcc7d2411992085fbb829ec4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:05:47.645008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17dc2c6f-e588-4c05-98c3-7924e7e1b180 tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 200 len: 1225 microversion: 2.1 time: 0.099827 Jul 11 16:05:47.645768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1042/2145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:05:47 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:05:47.651110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:05:47.652085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:05:47.659221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:47.659649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:47.660464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:47.660890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:47.879352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 88cc8ab2-ba6d-49ba-af09-a265ba22234a {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:05:47.966762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lazy-loading 'services' on Instance uuid 88cc8ab2-ba6d-49ba-af09-a265ba22234a {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:05:47.985230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Request method failure captured: Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d HTTP/1.1 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEdNvZy9yflCrMpFp8Osq7uPJLM-7zobldm-wm42W--58q5VwHsniMlEnzA3gxXy0rhD3edYBaR_anfSqMV05IfQGedbf_d3J2NMAkjWnWrTI436QWrvBBRJx6nhjOyaWnGpW_f-daQ-xUaqFsZnd7lz-9PxLrqQhDnz9jzyU1eUk3Q Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:05:47.989510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b09e1a0de62456d90789370bba74b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b09e1a0de62456d90789370bba74b53"}]}] Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 99827ab52d9242f385177cada4335b38 Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:47.990889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'server_id': '88cc8ab2-ba6d-49ba-af09-a265ba22234a', 'id': '55f5069b-f17a-4118-8fbc-23dd7f6de61d'} Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:47.991514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:47.992568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.993833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:47.995041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) Jul 11 16:05:47.996681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:47.998329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da240a88-2392-4f8a-8e49-d94cb2393678) {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:05:47.998329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7c69b5d-cafb-43e6-acd0-56d5a91c1d23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d" status: 400 len: 269 microversion: 2.1 time: 61.157732 Jul 11 16:05:47.998329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1104/2146] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:04:46 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d => generated 269 bytes in 61159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:05:48.038626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Request method failure captured: Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d HTTP/1.1 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEdNvZy9yflCrMpFp8Osq7uPJLM-7zobldm-wm42W--58q5VwHsniMlEnzA3gxXy0rhD3edYBaR_anfSqMV05IfQGedbf_d3J2NMAkjWnWrTI436QWrvBBRJx6nhjOyaWnGpW_f-daQ-xUaqFsZnd7lz-9PxLrqQhDnz9jzyU1eUk3Q Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:05:48.040880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b09e1a0de62456d90789370bba74b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b09e1a0de62456d90789370bba74b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b09e1a0de62456d90789370bba74b53"}]}] Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 6b09e1a0de62456d90789370bba74b53 Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630154212 Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 99827ab52d9242f385177cada4335b38 Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotTestJSON-630154212-project Jul 11 16:05:48.042293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'server_id': '88cc8ab2-ba6d-49ba-af09-a265ba22234a', 'id': '55f5069b-f17a-4118-8fbc-23dd7f6de61d'} Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:48.042920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 16:05:48.043970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.045188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:48.046355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) Jul 11 16:05:48.047664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.050010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d83f374-85b2-4d1c-b09d-fa23e9d76fde) {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:05:48.050010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4c1eaf5c-43f3-4fff-b745-2578101d96b0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d" status: 400 len: 269 microversion: 2.1 time: 0.395416 Jul 11 16:05:48.050010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1043/2147] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:05:47 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a/os-volume_attachments/55f5069b-f17a-4118-8fbc-23dd7f6de61d => generated 269 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:05:48.669965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:05:48.670981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] [instance: 3bc150a1-4fb4-44a9-8bbc-641cb207d92f] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:05:48.678255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:48.678702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:48.679667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:05:48.680102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:05:48.694697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] HTTP exception thrown: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Request method failure captured: Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f HTTP/1.1 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEcKmWS-U2t51ZUNO_N8eWJW8eB5M1st1sMUpsXD_OhaMHM5R6eWjqMcg6ANHYo8PqXiMiFM9_2GKBwaYbb3N0Eq3aCTpwNVCVmNzB526jSE8B2IycjbrAWwT0wDBHWfpk2-shre7WLsNjWE-GqPbtELh0joXvO0DYyF-4_K1N5tLYo Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 34616afcc7d2411992085fbb829ec4d8 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-TestVolumeBootPattern-430943135 Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:05:48.696577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/34616afcc7d2411992085fbb829ec4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/34616afcc7d2411992085fbb829ec4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_34616afcc7d2411992085fbb829ec4d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/34616afcc7d2411992085fbb829ec4d8"}]}] Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-TestVolumeBootPattern-430943135 Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 34616afcc7d2411992085fbb829ec4d8 Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-TestVolumeBootPattern-430943135 Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-TestVolumeBootPattern-430943135-project Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 0c2fbf5d3064479a909e7547a050ef5e Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-TestVolumeBootPattern-430943135-project Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. Jul 11 16:05:48.698103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '3bc150a1-4fb4-44a9-8bbc-641cb207d92f'} Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:05:48.699033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. Jul 11 16:05:48.700507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:05:48.702132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Returning 404 to user: Instance 3bc150a1-4fb4-44a9-8bbc-641cb207d92f could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:05:48.702132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f303cac5-85a8-433f-8af0-1aca930891dd tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f" status: 404 len: 111 microversion: 2.1 time: 0.036534 Jul 11 16:05:48.702132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1105/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:05:48 2022] GET /compute/v2.1/servers/3bc150a1-4fb4-44a9-8bbc-641cb207d92f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:06:30.423346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:06:30.423837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:06:37.305483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:06:37.306422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:06:50.566453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:06:50.567331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:06:51.577115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:06:51.577778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:07:46.220233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 16:07:46.220860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:46.221567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=14 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:46.226718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:46.229716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:46.237086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.237526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.238499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.238862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.264959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:07:46.268908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:46.269975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:46.273137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 16:07:46.273605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:46.276626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:46.284080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.284883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.285925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.286604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.323049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:07:46.368310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7502f0b7-e3a9-4a35-9774-3ae0c49e9776 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 204 len: 0 microversion: 2.20 time: 0.149491 Jul 11 16:07:46.369472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1044/2149] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 16:07:46 2022] DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 16:07:46.379960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:46.381797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:46.389391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.390011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.391264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.391709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.414171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-69a3f03a-9a84-4715-95b0-64e0e8ed4ac1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 204 len: 0 microversion: 2.1 time: 0.150477 Jul 11 16:07:46.415069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1106/2150] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:07:46 2022] DELETE /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:07:46.425507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:46.426463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:46.433293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.433828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.434663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:46.435275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:46.588131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:46.597169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:46.598824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:46.600152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-63b6f860-4473-4b85-b3af-986bd957e682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1801 microversion: 2.20 time: 0.225689 Jul 11 16:07:46.600814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1045/2151] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:07:46.618790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:46.630887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5637b00-9048-4aa3-8c0f-04c27c1a6e49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.210860 Jul 11 16:07:46.631450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1107/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:47.619397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:47.620017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:47.628990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:47.629431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:47.630249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:47.630853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:47.636679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48914. Jul 11 16:07:47.653995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:47.655043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:47.664632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:47.665118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:47.665904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:47.666336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:47.673013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48918. Jul 11 16:07:47.698043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:47.707537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:47.709325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:47.710792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49f13c19-0529-40f3-ae5f-25b4e5e4f12d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1734 microversion: 2.20 time: 0.095641 Jul 11 16:07:47.711349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1046/2153] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1734 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:47.802759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:47.812047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9963395-4829-41bf-8ef1-bca7a800317b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162595 Jul 11 16:07:47.812731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1108/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:47.903250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-eb2b1fa7-240b-4555-8770-e401b8d821ba req-30853389-a07e-4f7d-a441-56c04f830ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6ea184-76c8-4450-97c5-b81cbc8aacbd", "name": "network-vif-deleted", "tag": "bd37a731-9723-4a17-a5f7-39d36a61359a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:07:47.915086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-eb2b1fa7-240b-4555-8770-e401b8d821ba req-30853389-a07e-4f7d-a441-56c04f830ab8 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:47.915584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-eb2b1fa7-240b-4555-8770-e401b8d821ba req-30853389-a07e-4f7d-a441-56c04f830ab8 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:47.928596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-eb2b1fa7-240b-4555-8770-e401b8d821ba req-30853389-a07e-4f7d-a441-56c04f830ab8 service nova] Creating event network-vif-deleted:bd37a731-9723-4a17-a5f7-39d36a61359a for instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd on hv-cinder-79760 Jul 11 16:07:47.934178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-eb2b1fa7-240b-4555-8770-e401b8d821ba req-30853389-a07e-4f7d-a441-56c04f830ab8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109635 Jul 11 16:07:47.935375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1047/2155] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:07:48.729789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:48.730383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:48.737918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:48.739168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:48.740081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:48.740595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:48.810006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:48.818956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:48.820499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:48.821630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d219318-d2d5-44c9-a6f0-753637dbd2cc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096056 Jul 11 16:07:48.822434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1109/2156] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:48.839213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:48.840085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:48.846748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:48.847269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:48.848040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:48.848576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:48.985700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:48.993763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ccbfd36-1b0e-4955-b1ba-890dfc083ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.159292 Jul 11 16:07:48.994541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1048/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:49.844853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:49.845888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:49.857218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:49.857977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:49.859245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:49.859984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:49.924865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:49.933694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:49.935278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:49.936461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-72ef314c-b146-4c28-94b5-01548afef3e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098534 Jul 11 16:07:49.937028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1110/2158] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:50.015159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:50.016086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:50.024955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:50.025396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:50.026145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:50.026595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:50.164343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:50.170994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d6ffa062-0f27-4be6-8183-dadd903bddec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162877 Jul 11 16:07:50.171601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1049/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:50.960625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:50.961576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:50.974782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:50.975244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:50.976022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:50.976489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:51.049632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:51.059116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:51.060652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:51.061781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f2d04af-7ae3-435c-b94d-bf5f3ed2536f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109376 Jul 11 16:07:51.062343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1111/2160] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:51.192521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:51.193529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:51.201088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:51.201531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:51.202293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:51.202725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:51.333231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:51.341648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-520dd338-0f74-4c5f-8629-e24be7de5e82 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.155708 Jul 11 16:07:51.342220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1050/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:52.083433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:52.084265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:52.091644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:52.092102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:52.092900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:52.093343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:52.154116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:52.162674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:52.164205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:52.165375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bdd0ee92-fcb1-4769-85af-3a9dd5e0bb80 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088016 Jul 11 16:07:52.165938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1112/2162] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:52.363119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:52.364007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:52.375212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:52.375961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:52.377298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:52.377984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:52.755119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:52.763486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5383a04e-d8a9-4f7e-afbd-3000babbe32e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.406984 Jul 11 16:07:52.764056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1051/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:53.184924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:53.185546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:53.193086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:53.193547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:53.194430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:53.195019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:53.268668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:53.277797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:53.279313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:53.280477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e47b95a-c1dd-47b8-ad94-60179ea3adc3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100382 Jul 11 16:07:53.281062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1113/2164] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:53.784902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:53.785904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:53.797188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:53.797930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:53.799178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:53.799909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:53.961245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:53.973792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e61a41e9-0aee-4973-94cc-979cd1b2d8a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.195224 Jul 11 16:07:53.974583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1052/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:54.299224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:54.299847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:54.306969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:54.307448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:54.308222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:54.308663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:54.372723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:54.382093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:54.383800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:54.385114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e266277-7f4a-4bf9-ac44-094cdfc4f287 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090088 Jul 11 16:07:54.385676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1114/2166] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:54.991305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:54.992012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:54.999020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:54.999466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:55.000192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:55.000681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:55.148322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:55.156858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3a297fd4-a31d-409e-aac3-ca4af25c39a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169467 Jul 11 16:07:55.157408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1053/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:55.408945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:55.409858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:55.419091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:55.419534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:55.420322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:55.420760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:55.495238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:55.504209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:55.505746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:55.506880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-999c37f7-4c0e-47b7-a17f-443cc0be15f0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104604 Jul 11 16:07:55.507442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1115/2168] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:55.701944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:07:55.702287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:07:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:07:56.177482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:56.178499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:56.189671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:56.190459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:56.191750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:56.192500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:56.333321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:56.346494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a025c52b-d689-43e6-b4d5-910f4b52b220 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.175210 Jul 11 16:07:56.347301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1054/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:56.527995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:56.528590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:56.535898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:56.536728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:56.537165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:56.537710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:56.603891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:56.612954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:56.614467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:56.615631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c7c4a7bf-fc20-4f39-b70b-1eea3c28faf4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093185 Jul 11 16:07:56.616211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1116/2170] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:57.366483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:57.367065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:57.374497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:57.374945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:57.375696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:57.376132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:57.516208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:57.524937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d25ddf3d-d8bb-4312-9893-27198e3e243e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162399 Jul 11 16:07:57.525521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1055/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:57.638328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:57.639278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:57.649938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:57.650579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:57.651529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:57.652243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:57.723351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:57.732430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:57.733938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:57.735065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-996db7e4-686e-4259-8a60-016ed680f759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103779 Jul 11 16:07:57.735632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1117/2172] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:58.543089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:58.543697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:58.550890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:58.551334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:58.552107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:58.552571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:58.685041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:58.697628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-90bf376b-5afa-4bfb-92b0-5aa96d3322b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.158466 Jul 11 16:07:58.698420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1056/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:58.757610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:58.758481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:58.769637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:58.770390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:58.771647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:58.772381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:58.841691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:58.854456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:58.857120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:58.858888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2afeb7a9-aca9-4f1e-932d-d21e23ff6bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107708 Jul 11 16:07:58.859696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1118/2174] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:07:59.722200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:59.722819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:59.730575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:59.731052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:59.731845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:59.732320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:59.878644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:07:59.879637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:07:59.879855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:59.889281 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:59.889731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:59.890026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32c20c2b-1963-4454-b52e-3d1d5dc111da tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.172158 Jul 11 16:07:59.890472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:07:59.890907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:07:59.893510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1057/2175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:07:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:07:59.961318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:59.970810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:59.972409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:07:59.973481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d4f0055-ff79-4062-b33c-63d4c323e51c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099837 Jul 11 16:07:59.974046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1119/2176] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:07:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:00.907861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:00.908499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:00.915492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:00.915946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:00.916794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:00.917494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:00.994054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:00.994669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:01.001680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:01.002127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:01.002889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:01.003317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:01.074730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:01.078005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:01.078198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:01.085122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:01.086608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:01.086726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-75bfaf56-68ad-48ab-8082-b0b21beff073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.182795 Jul 11 16:08:01.087243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1058/2177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:01.087753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e9f3978d-d3c8-41f6-9527-e44668f74ad1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097794 Jul 11 16:08:01.088270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1120/2178] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:02.105017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:02.105764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:02.106265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:02.108538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:02.113052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:02.113562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:02.114389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:02.115008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:02.116400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:02.116886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:02.117682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:02.118131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:02.136332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:02.212919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:02.221922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:02.223563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:02.224850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-299b394d-2de4-4850-8c58-985398982f22 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.123055 Jul 11 16:08:02.225502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1121/2179] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:02.299356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:02.308019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10829f87-e7cb-4561-b0bc-270acf234e1b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.207342 Jul 11 16:08:02.308638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1059/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:03.243706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:03.244282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:03.251409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:03.251936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:03.252735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:03.253178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:03.320701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:03.325898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:03.326519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:03.329745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:03.331272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:03.332825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-121ea036-057c-420f-a6b5-7684587fab62 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093180 Jul 11 16:08:03.333388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1122/2181] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:03.333894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:03.334350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:03.335105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:03.335536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:03.469241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:03.477858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-764827a5-a193-4c25-a24a-086f80ea493f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156335 Jul 11 16:08:03.478444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1060/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:04.355244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:04.356271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:04.364021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:04.364503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:04.365266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:04.365700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:04.431161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:04.444240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:04.446221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:04.447366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d1c4c948-4354-41c1-9451-1279ce18328c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098903 Jul 11 16:08:04.448250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1123/2183] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:04.499713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:04.500332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:04.507398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:04.507852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:04.508662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:04.509135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:04.643573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:04.652185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-879a61be-9110-49e2-936f-2cb58571cbd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156593 Jul 11 16:08:04.652808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1061/2184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:05.470038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:05.470771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:05.479711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:05.480322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:05.481382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:05.481982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:05.555063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:05.564846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:05.566361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:05.567509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b2f80dd-49be-4521-8cb7-177a22f6fec2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104035 Jul 11 16:08:05.568074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1124/2185] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:05.673613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:05.674571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:05.685817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:05.686261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:05.687011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:05.687435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:05.829944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:05.838983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a6c991b6-85f9-4a24-af2e-263714a5b49e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.172091 Jul 11 16:08:05.839573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1062/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:06.589315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:06.590193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:06.599598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:06.600201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:06.601265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:06.601853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:06.667843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:06.676788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:06.678331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:06.679470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-302ce626-841e-4c9c-90e1-66eb3e0066ec tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095546 Jul 11 16:08:06.680035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1125/2187] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:06.859746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:06.860570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:06.869080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:06.869643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:06.870583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:06.871156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:07.017227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:07.029843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27ef3d81-da40-40d8-b7a4-e59977f25976 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.175539 Jul 11 16:08:07.030423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1063/2188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:07.702104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:07.703098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:07.714606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:07.715358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:07.716764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:07.717204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:07.790565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:07.803973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:07.806384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:07.808068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0d1971e-01f6-4f9f-aba2-eaa02e798d5a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112787 Jul 11 16:08:07.808874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1126/2189] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:08.050199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:08.051205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:08.062203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:08.062956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:08.064211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:08.064987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:08.205863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:08.218314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74f13d57-2d36-4a6c-b5e0-794432d5b9bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.174488 Jul 11 16:08:08.219096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1064/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:08.831086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:08.832531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:08.843482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:08.844275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:08.845572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:08.846292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:08.914494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:08.923437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:08.924981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:08.926113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1b199d5-5d05-4575-a0cb-9553d3bc54b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101765 Jul 11 16:08:08.926698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1127/2191] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:09.236600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:09.237214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:09.244110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:09.244616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:09.245376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:09.245813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:09.390514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:09.399069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1ad4b3f-5df6-4f6e-aef3-c5d534b8b202 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166584 Jul 11 16:08:09.399647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1065/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:09.949175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:09.950152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:09.962142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:09.962906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:09.964180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:09.964963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:10.031200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:10.040005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:10.041566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:10.042727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3241d06e-d634-41cb-98ec-12cc4905e87a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100877 Jul 11 16:08:10.043300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1128/2193] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:10.421997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:10.422717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:10.431647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:10.432182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:10.433153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:10.433773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:10.576185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:10.584885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3666ed75-1dfe-48d2-b040-7a8cc8671dd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169438 Jul 11 16:08:10.585457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1066/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:11.065800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:11.066771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:11.077645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:11.078107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:11.078842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:11.079276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:11.141699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:11.150267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:11.151768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:11.152923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9bf497b2-f9c2-421d-af08-b673092e8312 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094373 Jul 11 16:08:11.153499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1129/2195] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:11.606547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:11.607712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:11.618876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:11.619609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:11.620917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:11.621632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:11.771741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:11.780443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ecce1d18-f6b4-4c18-a6cf-64d076e5af36 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.180401 Jul 11 16:08:11.780992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1067/2196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:12.175584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:12.176676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:12.187008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:12.187504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:12.188232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:12.188691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:12.262645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:12.271283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:12.272808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:12.273949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-02e6c188-0027-481c-9a1d-2b66e052ca07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104996 Jul 11 16:08:12.274520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1130/2197] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:12.803040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:12.803629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:12.811373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:12.811827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:12.812621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:12.813053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:12.962139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:12.970859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-404a152f-c77b-4911-9cdd-8a8431c46be1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.171839 Jul 11 16:08:12.971440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1068/2198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:13.296963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:13.297652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:13.305330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:13.305863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:13.306760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:13.307276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:13.377617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:13.386614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:13.388122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:13.389349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-21dd164a-64f8-4c88-b05c-3cb8ef7c8c5b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099010 Jul 11 16:08:13.389911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1131/2199] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:13.987340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:13.987935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:13.994898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:13.995353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:13.996155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:13.996661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:14.142033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:14.152711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-de04dac7-02b2-443f-8195-cf09f48a0956 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168589 Jul 11 16:08:14.153586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1069/2200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:14.411425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:14.412415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:14.423531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:14.424276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:14.425556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:14.426265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:14.495937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:14.505202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:14.506699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:14.507831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-58a6cbbb-7667-4f3a-bfab-fb3ee8f09171 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103193 Jul 11 16:08:14.508412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1132/2201] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:15.175114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:15.176135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:15.187159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:15.187615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:15.188416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:15.188852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:15.321260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:15.329927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3abc425-2223-4a96-89e7-c2a92e06e9f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.161376 Jul 11 16:08:15.330501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1070/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:15.528576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:15.529337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:15.538854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:15.539460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:15.540509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:15.541095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:15.605585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:15.614657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:15.616111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:15.617280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57257f2d-999b-4a31-b6ba-9181b1cabdbd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094031 Jul 11 16:08:15.617844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1133/2203] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:16.351950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:16.352947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:16.356562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:16.363087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:16.363528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:16.364278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:16.364730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:16.496344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:16.505255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-35222886-f554-431e-9f47-3242b317e1d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.160053 Jul 11 16:08:16.505853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1071/2204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:16.640604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:16.641617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:16.645454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:16.654564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:16.655583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:16.656398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:16.656825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:16.734559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:16.743566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:16.745123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:16.746269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ad85c0d-f798-444f-8180-3b9cf8baff48 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113335 Jul 11 16:08:16.746827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1134/2205] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:16.831292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:08:16.831632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:08:17.527305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:17.528427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:17.536707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:17.537162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:17.537922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:17.538355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:17.684564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:17.693696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a95ad16a-6532-4657-ae49-854f8f1ca988 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173064 Jul 11 16:08:17.694307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1072/2206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:17.767958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:17.768648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:17.776499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:17.776974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:17.777940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:17.778386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:17.848833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:17.857797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:17.859430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:17.860612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3bbeb734-d4d2-48ee-85fa-81d13d21c1f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098048 Jul 11 16:08:17.861171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1135/2207] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:18.716937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:18.717892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:18.729219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:18.729856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:18.731097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:18.731772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:18.879046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:18.879642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:18.881918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:18.886476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:18.886928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:18.887689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:18.888122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:18.890196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb8ba5d1-5bc2-475f-bc76-1265cde7f292 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.179987 Jul 11 16:08:18.891384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1073/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:18.952075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:18.961426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:18.962920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:18.964055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-311756da-b557-472a-a4af-3b04272bfa7b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089063 Jul 11 16:08:18.964660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1136/2209] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:19.911892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:19.912966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:19.924126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:19.924948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:19.926197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:19.926918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:19.982270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:19.982890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:19.989683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:19.990136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:19.990890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:19.991332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:20.011776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:20.067165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:20.075963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:20.077835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:20.078722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-30384806-4dcb-4641-abef-6c6319bc41ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100431 Jul 11 16:08:20.079309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1137/2210] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:20.089638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:20.102761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ddf106ba-bb40-49f2-a1fa-a4c46c0137f6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.197099 Jul 11 16:08:20.103502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1074/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:21.101280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:21.101902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:21.111765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:21.112330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:21.113439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:21.114031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:21.121993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:21.122579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:21.129823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:21.130266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:21.131022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:21.131443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:21.189744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:21.198761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:21.200283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:21.201455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fd57f0b4-9517-481f-95f6-c28cbe5c12a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.106663 Jul 11 16:08:21.202064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1138/2212] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:21.282965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:21.291324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a082740c-ff97-471c-8c53-4181f406e0c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173155 Jul 11 16:08:21.292145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1075/2213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:22.220425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:22.221054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:22.227986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:22.228476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:22.229233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:22.229673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:22.292543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:22.301165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:22.302668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:22.303809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7abbc22a-dfa9-4bda-9eb8-1d1f3d5fdecb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087579 Jul 11 16:08:22.304341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1139/2214] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:22.308751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:22.309364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:22.316414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:22.316856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:22.317600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:22.318023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:22.321957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:22.463894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:22.474529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3bf8379a-27c8-4fb9-9018-9f75afa14dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169497 Jul 11 16:08:22.475203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1076/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:23.326680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:23.327740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:23.339500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:23.340244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:23.341560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:23.342282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:23.415851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:23.429150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:23.431476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:23.433345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aa3f74f2-aab7-4d77-b1d2-5dd2fc5fe16b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113086 Jul 11 16:08:23.434129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1140/2216] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:23.495874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:23.496438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:23.504019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:23.504505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:23.505260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:23.505693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:23.659463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:23.671752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b21eaf14-d4f6-49cb-a350-76a11c3b63a6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.179840 Jul 11 16:08:23.672640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1077/2217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:24.455328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:24.455901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:24.465911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:24.466365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:24.467132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:24.467565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:24.534869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:24.548487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:24.550002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:24.551138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b3ff7b0c-100c-4aef-b66d-c88dbc7fe4c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102489 Jul 11 16:08:24.551696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1141/2218] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:24.693534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:24.694658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:24.704975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:24.705480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:24.706165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:24.706590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:24.838282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:24.848889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0996014f-9d23-47ca-bf9e-c14e858d8f24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.161887 Jul 11 16:08:24.849462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1078/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:25.578610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:25.579733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:25.588206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:25.588768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:25.589617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:25.590108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:25.653602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:25.662796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:25.664324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:25.665502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11002359-a34c-435e-8ab9-44b9867c0d01 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093313 Jul 11 16:08:25.666074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1142/2220] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:25.868199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:25.869032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:25.877679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:25.878124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:25.878865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:25.879291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:26.026807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:26.035074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf7cc449-a4a6-4a42-ae52-e883d20ed728 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.172156 Jul 11 16:08:26.035651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1079/2221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:26.687968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:26.689531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:26.700342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:26.701076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:26.702351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:26.703078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:26.778786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:26.788180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:26.789719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:26.790858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9688d30c-8771-47b3-8161-36c3d21fa81f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109581 Jul 11 16:08:26.791388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1143/2222] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:27.056763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:27.057754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:27.067401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:27.067857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:27.068657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:27.069092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:27.216725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:27.225490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-898c885d-ef86-4e58-bc10-e235a9921cc2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.175316 Jul 11 16:08:27.226036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1080/2223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:27.809742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:27.810372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:27.817992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:27.818437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:27.819207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:27.819643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:27.885146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:27.894615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:27.896194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:27.897394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c1416da3-0295-4ed4-a653-bb4fecba03c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091724 Jul 11 16:08:27.897961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1144/2224] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:28.246981 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:28.247943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:28.259772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:28.260583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:28.261819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:28.262531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:28.402704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:28.415832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-668ebe2e-cccb-46bd-9222-032ff3e602e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.175196 Jul 11 16:08:28.416747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1081/2225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:28.923750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:28.924613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:28.932148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:28.932673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:28.933499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:28.933980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:29.001279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:29.010693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:29.012222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:29.013383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1f5f3fa-5360-44d9-bb39-3aba07b2de2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096720 Jul 11 16:08:29.013945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1145/2226] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:29.436982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:29.437951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:29.448004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:29.448004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:29.448425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:29.448775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:29.751288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:29.763701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3801fc98-7ba0-4381-946c-598178d99f22 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.331707 Jul 11 16:08:29.764652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1082/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:30.034950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:30.035512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:30.042689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:30.043145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:30.043902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:30.044346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:30.112257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:30.123352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:30.124906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:30.126058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-520c4b24-ff87-4d19-bead-1c8d1c427ecd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096960 Jul 11 16:08:30.126840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1146/2228] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:30.785398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:30.785960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:30.792883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:30.793343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:30.794099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:30.794538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:30.935599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:30.947173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64d53641-5fac-4ccb-9288-ae0b28e51a5f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167220 Jul 11 16:08:30.947918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1083/2229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:31.147029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:31.147631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:31.154556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:31.155033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:31.155789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:31.156227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:31.228479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:31.240552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:31.242075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:31.243224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4a9e303-6bdb-4974-b9e2-e550a770e357 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101006 Jul 11 16:08:31.243790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1147/2230] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:31.969264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:31.970247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:31.982141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:31.982886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:31.984129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:31.984896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:32.118153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:32.126351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b74b277-31bc-4f2c-9200-652573f06c8f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163772 Jul 11 16:08:32.127181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1084/2231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:32.270954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:32.271587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:32.279978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:32.280559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:32.281449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:32.281962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:32.352173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:32.361300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:32.362838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:32.363984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1267f135-1ee8-465f-b6cf-2fcec653726b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099618 Jul 11 16:08:32.364576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1148/2232] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:33.148005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:33.149192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:33.159455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:33.159907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:33.160705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:33.161138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:33.310032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:33.318721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39e155c2-0347-4652-8b40-fedaea1fda01 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.177445 Jul 11 16:08:33.319286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1085/2233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:33.391034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:33.392044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:33.399872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:33.400249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:33.401037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:33.401467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:33.467430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:33.476489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:33.477999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:33.479144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d81fa870-210c-4fd4-83ee-b248bcc32184 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094699 Jul 11 16:08:33.479712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1149/2234] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:34.335648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:34.336266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:34.343102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:34.343543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:34.344312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:34.344760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:34.478390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:34.486823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2d9531d-169b-460b-9eb8-5fe3f421a932 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.155556 Jul 11 16:08:34.487395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1086/2235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:34.497545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:34.498151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:34.504967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:34.505409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:34.506164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:34.506591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:34.581737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:34.592235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:34.593768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:34.594922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e27ead1-bac9-4758-9784-d0dcbc216903 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101312 Jul 11 16:08:34.595495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1150/2236] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:35.507645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:35.508232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:35.515054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:35.515508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:35.516272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:35.516751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:35.613461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:35.614023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:35.621055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:35.621501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:35.622254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:35.622687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:35.652445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:35.661062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a53d07c-e4db-48c3-b68e-d2a54bd47de9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.159172 Jul 11 16:08:35.661866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1087/2237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:35.688330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:35.697491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:35.698994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:35.700129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67a26419-9865-493d-8b62-8dc50f43ae0c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090703 Jul 11 16:08:35.700692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1151/2238] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:36.680756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:36.681328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:36.688481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:36.688918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:36.689674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:36.690111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:36.719012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:36.719587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:36.727312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:36.727765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:36.728594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:36.729041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:36.811343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:36.820324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:36.821873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:36.823041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ff00fd72-0b08-42cd-bebe-dd270c174b28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107963 Jul 11 16:08:36.823971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1152/2239] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:36.850013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:36.858670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-13afcfa9-dee9-4a58-946d-0ed72690c9be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.182395 Jul 11 16:08:36.859240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1088/2240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:37.845849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:37.846792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:37.857949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:37.858696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:37.859931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:37.860706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:37.875025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:37.875711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:37.882801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:37.883328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:37.884104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:37.884569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:37.935275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:37.944308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:37.945884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:37.947033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2f3551b-82f6-436c-b23e-46a46a791269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107896 Jul 11 16:08:37.947595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1153/2241] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:38.027875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:38.040160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05ed597c-f861-4ed7-a4c7-5ae567dd69a9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168703 Jul 11 16:08:38.040960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1089/2242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:38.970023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:38.971073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:38.979568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:38.980024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:38.980836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:38.981269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:38.985257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:39.047383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:39.056702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:39.058206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:39.059342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-92b4178d-c5d2-45d1-bb8d-2a13c55e9176 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095978 Jul 11 16:08:39.059908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1154/2243] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:39.061325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:39.062078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:39.069215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:39.069668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:39.070437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:39.070873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:39.208931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:39.217465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-694eee02-a121-46b5-84ab-2deb9c8ed5c9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.160038 Jul 11 16:08:39.218058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1090/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:40.082459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:40.083429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:40.090865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:40.091313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:40.092073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:40.092546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:40.159916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:40.173774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:40.176347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:40.178327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-080eca23-e69f-44f4-898a-972203b85148 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102415 Jul 11 16:08:40.178874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1155/2245] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:40.235907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:40.236548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:40.243879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:40.244319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:40.245118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:40.245583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:40.388048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:40.396090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49d1c34b-6ad4-4ed4-9a72-3bbffed20936 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164223 Jul 11 16:08:40.397266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1091/2246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:41.198565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:41.199178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:41.206269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:41.206723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:41.207820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:41.208253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:41.280007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:41.290718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:41.292216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:41.293408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5553b10e-687f-4d9b-b635-77b07ad08f28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098977 Jul 11 16:08:41.293976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1156/2247] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:41.418042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:41.419062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:41.430227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:41.431019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:41.432233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:41.433017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:41.577930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:41.581459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:41.587314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6f515a67-192b-41a0-ac12-b15a4fe77fab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.176043 Jul 11 16:08:41.587977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1092/2248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:42.316157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:42.317219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:42.328531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:42.329582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:42.330841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:42.331574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:42.399420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:42.408044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:42.409624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:42.410773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a2301cc-d1e8-4460-916d-1f659fe679df tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101345 Jul 11 16:08:42.411347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1157/2249] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:42.605228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:42.606005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:42.612952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:42.613401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:42.614177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:42.614602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:42.752608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:42.761048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5831dfae-95db-425d-829f-32c37d6e384e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.160940 Jul 11 16:08:42.761588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1093/2250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:43.439092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:43.440018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:43.448525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:43.448892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:43.449645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:43.450074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:43.513967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:43.522670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:43.524160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:43.525316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28021b80-5561-44cc-a1c7-a72f17072d28 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093021 Jul 11 16:08:43.525872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1158/2251] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:43.787923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:43.788842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:43.799768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:43.800571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:43.801814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:43.802527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:43.941614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:43.949780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b91c9bae-0022-4ee0-af32-c8ed969aeb5b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168751 Jul 11 16:08:43.950325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1094/2252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:44.547317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:44.548518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:44.557273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:44.557725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:44.558482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:44.558922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:44.625557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:44.634554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:44.636056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:44.637213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-697690c3-7de6-41ed-8871-742593652109 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096556 Jul 11 16:08:44.637768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1159/2253] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:44.971542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:44.972520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:44.980504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:44.980951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:44.981703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:44.982132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:45.123354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:45.132078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ac4a045a-c8fa-49f1-984a-e663fe588f08 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166754 Jul 11 16:08:45.132696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1095/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:45.659137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:45.660073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:45.668098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:45.668566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:45.669345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:45.669775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:45.736349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:45.745602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:45.747098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:45.748464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b08bbb3-5300-48a6-9cba-4281017adeb5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095870 Jul 11 16:08:45.749049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1160/2255] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:46.151799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:46.152404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:46.161896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:46.162491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:46.163523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:46.164029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:46.301768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:46.311130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29295e89-919d-4f64-8e40-9e9493560f49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164285 Jul 11 16:08:46.311716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1096/2256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:46.770398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:46.770934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:46.774077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=54 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:46.779667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:46.780111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:46.780891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:46.781312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:46.853187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:46.867289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:46.868831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:46.869973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e93fe0a-ed56-4d02-aea7-e4200ff1f543 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.106152 Jul 11 16:08:46.870536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1161/2257] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:47.333186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:47.334146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:47.337809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=52 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:47.346640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:47.347375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:47.348765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:47.349479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:47.483649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:47.491811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a0e348ac-cd4a-40f2-b9fb-c8d6a758eac7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.165584 Jul 11 16:08:47.492377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1097/2258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:47.898130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:47.899327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:47.909748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:47.910506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:47.911743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:47.912507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:47.982102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:47.990618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:47.992227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:47.993497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4acc1d98-f701-493f-840d-a06336cef241 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102252 Jul 11 16:08:47.994058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1162/2259] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:48.511559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:48.512575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:48.522817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:48.523553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:48.524871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:48.525298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:48.656014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:48.667671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-565c8809-9983-4e34-aaf9-7e3bb9f30b15 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.160853 Jul 11 16:08:48.668239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1098/2260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:49.012420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:49.013062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:49.020729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:49.021229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:49.022075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:49.022555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:49.087708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:49.096869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:49.098343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:49.099510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c11d31d-30ab-4ac6-85d9-71bbc5f87a92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092059 Jul 11 16:08:49.100037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1163/2261] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:49.689436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:49.690391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:49.702362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:49.703115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:49.704374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:49.705098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:49.843789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:49.852455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3cdb3aac-36b8-4927-9392-db969af8bf0f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170244 Jul 11 16:08:49.853027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1099/2262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:50.122954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:50.123966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:50.135036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:50.135781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:50.137378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:50.137785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:50.209424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:50.218353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:50.219863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:50.221025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3da457fc-d666-4e7c-88d5-a389e0360f43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.105507 Jul 11 16:08:50.221588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1164/2263] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:50.873810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:50.874846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:50.885747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:50.886489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:50.887922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:50.888419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:51.028361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:51.037078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17fb3753-c8af-49f4-b31b-5dd4d249b1e9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169966 Jul 11 16:08:51.037658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1100/2264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:51.238929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:51.239547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:51.246636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:51.247295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:51.248063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:51.248559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:51.310733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:51.319552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:51.321114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:51.322291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4fe39892-cded-4e20-93bf-3fd00cfa7bba tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087524 Jul 11 16:08:51.322836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1165/2265] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:52.057928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:52.058917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:52.066246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:52.066698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:52.067484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:52.067894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:52.210221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:52.218310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2699bf12-31a2-44e1-9b87-0623398e082f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167002 Jul 11 16:08:52.218877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1101/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:52.345176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:52.346028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:52.356767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:52.357394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:52.358149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:52.358583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:52.434507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:52.443455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:52.444980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:52.446110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-32735635-cb8c-4ea6-be91-809a4e87a476 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107682 Jul 11 16:08:52.446664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1166/2267] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:53.244227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:53.245281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:53.256826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:53.257677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:53.258938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:53.259655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:53.398282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:53.408142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-01ca177d-3b7a-4990-8c34-cdaf3ca5459f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170370 Jul 11 16:08:53.408746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1102/2268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:53.467348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:53.467911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:53.474833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:53.475291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:53.476057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:53.476547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:53.543648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:53.552632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:53.554144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:53.555290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b1687814-b1b0-4be8-9155-11e5542d1912 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093775 Jul 11 16:08:53.555837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1167/2269] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:54.426047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:54.426554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:54.433431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:54.433853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:54.434706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:54.435145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:54.567788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:54.573234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:54.573863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:54.575187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-94ab8edb-0d87-4639-b958-4544b5b293e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.152987 Jul 11 16:08:54.575875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1103/2270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:54.580868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:54.581330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:54.582388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:54.582824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:54.654176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:54.667431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:54.669500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:54.670725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a805e11-8ad6-469c-bb67-8ac627315c40 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101487 Jul 11 16:08:54.671283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1168/2271] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:55.593615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:55.594245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:55.601576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:55.602030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:55.602812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:55.603244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:55.689330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:55.689953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:55.697284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:55.697737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:55.698515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:55.698943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:55.773833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:55.775240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:55.782634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bac271a0-0b06-4ed2-90b2-2465297a4463 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.193502 Jul 11 16:08:55.783547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1104/2272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:55.784266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:55.785809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:55.786947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b34863b-6720-498b-8e7f-574fc8f05e77 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101705 Jul 11 16:08:55.797195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1169/2273] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:56.805205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:56.806064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:56.808498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:56.809752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:56.817427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:56.818176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:56.819440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:56.820160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:56.820460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:56.821201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:56.822445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:56.823159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:56.892969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:56.896469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:56.901945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:56.903454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:56.904620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c693c60b-8932-4b81-9f5d-426608db35f7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102505 Jul 11 16:08:56.905185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1170/2274] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:56.978443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:56.986917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-da1949a5-ff9c-4e82-8c62-b01022f4fef2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.188603 Jul 11 16:08:56.987488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1105/2275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:57.926210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:57.926996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:57.936192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:57.936669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:57.937418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:57.937848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:58.003394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:58.004061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:58.008388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:58.010893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:58.011335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:58.012089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:58.012580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:58.017305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:58.018874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:58.020002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b263c8fa-ad9e-4367-a871-fd359de2e70a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099735 Jul 11 16:08:58.020586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1171/2276] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:58.147040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:58.155389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b9d3f8c9-7873-496f-9517-cfafc0860cb9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156140 Jul 11 16:08:58.155977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1106/2277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:08:59.038616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:59.039272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:59.046246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:59.046695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:59.047456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:59.047901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:59.110379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:59.119321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:59.120884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:59.122053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-48e1a415-be96-4e9c-9878-30479f1d16b2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087596 Jul 11 16:08:59.122753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1172/2278] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:08:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:08:59.172883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:08:59.173492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:08:59.180145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:59.180619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:59.181366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:08:59.181801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:08:59.323585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:08:59.332879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8101d01-4584-4cd5-a272-a6ebe3bf031d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164168 Jul 11 16:08:59.333456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1107/2279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:08:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:00.143491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:00.144652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:00.154568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:00.155021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:00.155775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:00.156211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:00.225887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:00.234709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:00.236213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:00.237373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fcb6b21a-3a8f-4cfc-9f6b-34467e3828a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100269 Jul 11 16:09:00.237934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1173/2280] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:00.354188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:00.355239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:00.366893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:00.367659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:00.369020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:00.369736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:00.516953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:00.529253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-60fa2188-1e4b-4a2d-af84-8545f51876c2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.180956 Jul 11 16:09:00.529931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1108/2281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:01.259841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:01.260892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:01.268775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:01.269229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:01.269992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:01.270429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:01.338201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:01.347386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:01.348912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:01.350375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83d13663-8a46-45b8-86c5-8a7ed680589e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097170 Jul 11 16:09:01.350946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1174/2282] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:01.548053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:01.548695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:01.555210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:01.555660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:01.556452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:01.556905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:01.575150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:01.715034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:01.723550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-de525003-9753-4111-8673-9171055e71a3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.179685 Jul 11 16:09:01.724111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1109/2283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:02.372328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:02.372996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:02.381512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:02.381963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:02.382722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:02.383153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:02.453125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:02.463330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:02.464892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:02.466316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c81c1d4c-7b35-4c95-b686-d9ce5958f3cb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100455 Jul 11 16:09:02.466879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1175/2284] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:02.743645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:02.744739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:02.753134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:02.753727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:02.755198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:02.755887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:02.910051 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:02.919442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dfd2b5ca-e2d2-4900-aad4-6ff2abfb9ed4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.182120 Jul 11 16:09:02.920035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1110/2285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:03.485632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:03.486213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:03.493150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:03.493610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:03.494367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:03.494801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:03.588512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:03.597979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:03.599491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:03.600671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6621a070-db43-45cb-afff-aadff3b47def tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.119626 Jul 11 16:09:03.601233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1176/2286] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:03.942853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:03.943855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:03.954824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:03.955564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:03.957241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:03.957968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:04.097665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:04.106116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdcfd4e4-1073-4be6-913f-9caedde18630 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170050 Jul 11 16:09:04.106712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1111/2287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:09:04.623462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:04.624041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:04.631527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:04.631972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:04.632760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:04.633190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:04.698819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:04.708448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:04.709945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:04.711088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4f7476e5-f90b-4bd5-b665-95c852d8043b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094047 Jul 11 16:09:04.711671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1177/2288] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:05.131473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:05.132183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:05.141071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:05.141523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:05.142278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:05.142711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:05.297327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:05.309760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3e113959-8004-4de2-9348-8dce9424f4ab tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.184284 Jul 11 16:09:05.310575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1112/2289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:05.733270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:05.733984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:05.741003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:05.741449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:05.742201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:05.742629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:05.810621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:05.822565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:05.824964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:05.826219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1dced9d8-d2bd-45c7-9af8-06eeaf88a2b5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099120 Jul 11 16:09:05.826778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1178/2290] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:06.334444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:06.335307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:06.344762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:06.345239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:06.346017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:06.346444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:06.487833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:06.499726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c313adb9-048e-46d4-8a16-a0d32b88f0be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170859 Jul 11 16:09:06.500536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1113/2291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:06.846906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:06.847563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:06.855378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:06.855875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:06.857580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:06.858277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:06.927262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:06.938575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:06.940087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:06.941268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-626fe203-d33a-450f-8487-24754c78c2b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098836 Jul 11 16:09:06.941845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1179/2292] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:07.520402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:07.521126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:07.529965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:07.530551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:07.531539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:07.532109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:07.926925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:07.937917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c91efca3-fb40-42f6-89a0-897606c65680 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.422858 Jul 11 16:09:07.938494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1114/2293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:07.961693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:07.962273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:07.969234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:07.969670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:07.970423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:07.970854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:08.037985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:08.046591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:08.048085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:08.049237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-543cbafa-00d7-42bf-a5c2-024e681ae10f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091558 Jul 11 16:09:08.049798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1180/2294] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:08.959575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:08.960579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:08.972539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:08.973286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:08.974532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:08.975627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:09.069384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:09.069983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:09.078069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:09.078518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:09.079290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:09.079729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:09.133454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:09.141858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7a701434-9786-4f4f-80bd-ceee555ddc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.189271 Jul 11 16:09:09.142486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1115/2295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:09.149438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:09.158102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:09.159601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:09.160762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef263648-a6c1-4c36-b056-862036164377 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097536 Jul 11 16:09:09.161354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1181/2296] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:10.159491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:10.160122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:10.167415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:10.167867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:10.168652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:10.169081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:10.179286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:10.179873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:10.187188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:10.187788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:10.188672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:10.189109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:10.270005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:10.280786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:10.283153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:10.284467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cdd1f619-284d-4fdf-9c38-d4d6e630029b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109108 Jul 11 16:09:10.285021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1182/2297] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:10.335064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:10.347529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ea5ca319-4dbc-4788-8915-2bb6afc8bc4f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.191832 Jul 11 16:09:10.348327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1116/2298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:11.308002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:11.309290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:11.320476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:11.321557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:11.322793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:11.323586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:11.371648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:11.372371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:11.379724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:11.380175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:11.381085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:11.381525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:11.393820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:11.402417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:11.404008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:11.405331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8b25b84-f261-4ff5-a42f-6b9e69cf32c6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104656 Jul 11 16:09:11.405887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1183/2299] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:11.519388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:11.531411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1178f50-0aa1-44cd-9cf2-24fae3176e43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166240 Jul 11 16:09:11.531982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1117/2300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:12.427150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:12.428130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:12.438021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:12.438481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:12.439270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:12.439708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:12.502179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:12.511127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:12.512662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:12.513888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c5225978-b407-4488-836d-2580204d68e5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093509 Jul 11 16:09:12.514612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1184/2301] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:12.549231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:12.549843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:12.556996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:12.557451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:12.558197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:12.558628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:12.690692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:12.698833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5e28e92-0c6a-41f5-bb75-31ca43faa887 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.153509 Jul 11 16:09:12.699404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1118/2302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:13.535948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:13.536934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:13.547167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:13.547612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:13.548399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:13.548836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:13.626452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:13.636185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:13.637777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:13.638907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-01c46ab8-28bc-4e7c-a736-f13372960044 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109539 Jul 11 16:09:13.639527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1185/2303] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:13.719666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:13.720435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:13.729043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:13.729609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:13.730564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:13.731111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:13.868723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:13.876866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-db6a4077-99b5-4516-8a48-ec7270cf5fad tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163162 Jul 11 16:09:13.877413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1119/2304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:14.666912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:14.667873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:14.678407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:14.679149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:14.680391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:14.681143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:14.751794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:14.760481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:14.761970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:14.763101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d845f4a-44ca-405d-aeb1-4398146fc07c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102878 Jul 11 16:09:14.763680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1186/2305] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:14.903664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:14.904920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:14.915649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:14.916481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:14.917696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:14.918418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:15.067767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:15.075947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be8d2eef-6f09-4e3a-b277-975f0488f002 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.178876 Jul 11 16:09:15.076554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1120/2306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:15.784484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:15.785129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:15.792326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:15.792840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:15.793612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:15.794072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:15.814165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:15.866218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:15.877878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:15.879401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:15.880605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0bd74af9-016a-4cb4-99ec-aa9b02f49bb6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101835 Jul 11 16:09:15.881177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1187/2307] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:16.097615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:16.098533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:16.109728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:16.110539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:16.111844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:16.112702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:16.259799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:16.268581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-46d81fa2-e95f-492d-8599-049d2931e993 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.177612 Jul 11 16:09:16.269150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1121/2308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:16.903188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:16.904163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:16.908022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=54 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:16.917350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:16.918154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:16.919571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:16.920146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:16.990350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:17.001437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:17.002946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:17.004112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14a56ddf-63d9-4f4a-9642-ee9b4d06997b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107578 Jul 11 16:09:17.004703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1188/2309] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:17.290558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:17.292103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:17.308057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:17.309230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:17.311112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:17.312673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:17.467561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:17.476251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47eb5862-fb9b-46c0-9479-63b649c114ce tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.192926 Jul 11 16:09:17.476858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1122/2310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:18.029314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:18.030317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:18.037689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:18.038137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:18.038888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:18.039320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:18.108661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:18.117837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:18.119324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:18.120480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c33fe6a-06f2-484a-84e1-90367cf9af1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097958 Jul 11 16:09:18.121034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1189/2311] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:18.497675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:18.498832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:18.501961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=52 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:18.513889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:18.514620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:18.515882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:18.516793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:18.663979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:18.672887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ce8f369-e909-4988-ab7a-c12faaad7825 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.181533 Jul 11 16:09:18.673359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1123/2312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:19.142814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:19.143442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:19.150509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:19.150968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:19.151736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:19.152172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:19.220870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:19.229663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:19.231164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:19.232449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1680c663-75f2-4162-984d-9abb3735f38b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095907 Jul 11 16:09:19.233015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1190/2313] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:19.692456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:19.693091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:19.699915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:19.700367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:19.701145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:19.701575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:19.836279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:19.845008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-89fd3ce2-0616-4c31-bb04-2d6e7dd587e8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.157191 Jul 11 16:09:19.845591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1124/2314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:20.253547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:20.254108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:20.261215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:20.261659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:20.262417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:20.262849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:20.332346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:20.341106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:20.342597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:20.343732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39c98563-8dcd-4cac-8858-1b59ef5cd621 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095591 Jul 11 16:09:20.344304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1191/2315] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:20.865664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:20.866603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:20.877742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:20.878476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:20.879713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:20.880432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:21.024003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:21.032325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1093d81c-0f86-4ebe-b58b-3dc565a36032 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173093 Jul 11 16:09:21.032777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1125/2316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:21.364984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:21.365865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:21.376169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:21.376656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:21.377423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:21.377862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:21.441134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:21.449825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:21.451265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:21.452432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e341f182-6c5c-41b5-87bc-cbbb121f6691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093697 Jul 11 16:09:21.452993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1192/2317] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:22.058004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:22.058953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:22.068608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:22.069063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:22.069835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:22.070273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:22.074280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:22.207273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:22.215395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e3e2aa2d-2168-40d8-856c-93d1c7c8cafb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163950 Jul 11 16:09:22.215963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1126/2318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:22.474199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:22.474768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:22.481671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:22.482122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:22.482880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:22.483323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:22.547245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:22.555951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:22.557491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:22.558624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e98b9a0-c85d-465b-abf5-3788f6c9ad94 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089923 Jul 11 16:09:22.559181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1193/2319] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:23.232916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:23.233481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:23.240521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:23.240988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:23.241771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:23.242205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:23.376843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:23.385439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4ebc864-0735-4ad4-bd59-0853be71172b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156569 Jul 11 16:09:23.385990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1127/2320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:23.580886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:23.582058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:23.589108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:23.589561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:23.590315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:23.590752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:23.653117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:23.662375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:23.663879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:23.665059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-846daf50-84e0-4307-aa84-579ee109680c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090886 Jul 11 16:09:23.665808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1194/2321] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:24.402625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:24.403324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:24.410219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:24.410695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:24.411603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:24.412027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:24.557407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:24.565762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3756424-ec2d-4c0a-9749-b1244c43e4de tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167110 Jul 11 16:09:24.566304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1128/2322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:24.691829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:24.692592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:24.699439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:24.699892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:24.700693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:24.701137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:24.768404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:24.778033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:24.779547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:24.780729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bb05aa53-f9e0-4926-98f9-6ba631639443 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095862 Jul 11 16:09:24.781294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1195/2323] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:25.584841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:25.585437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:25.592480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:25.592930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:25.593685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:25.594128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:25.730228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:25.738367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ac4bb635-83c6-4e18-8584-d07c32b0432f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.158790 Jul 11 16:09:25.739078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1129/2324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:25.806422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:25.807401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:25.817982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:25.818682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:25.819847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:25.820580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:25.900318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:25.909433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:25.911025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:25.912183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-baa950f0-d713-42c7-af82-c175795be3af tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.111556 Jul 11 16:09:25.912785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1196/2325] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:26.758515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:26.759293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:26.768366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:26.769040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:26.770016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:26.770827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:26.917166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:26.926678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e52da68e-e40d-4a26-b125-66d8703b855a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173989 Jul 11 16:09:26.927270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1130/2326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:26.933615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:26.934428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:26.940436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:26.940893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:26.941727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:26.942166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:27.015411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:27.026055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:27.027605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:27.028769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-785e50dd-4de9-435c-a760-f5a1ba183b58 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099819 Jul 11 16:09:27.029336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1197/2327] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:27.949956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:27.950890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:27.960816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:27.961267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:27.962024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:27.962455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:28.052686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:28.053287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:28.059654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:28.060104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:28.060894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:28.061323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:28.132741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:28.135627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:28.141429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:28.142929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:28.143801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c300ea11-724a-43ff-b60e-efb4589bec29 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.200653 Jul 11 16:09:28.144065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-738beff3-8de0-4684-9c82-34893c3475c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095679 Jul 11 16:09:28.144396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1131/2328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:28.144682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1198/2329] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:09:29.161939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:29.162451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:29.162847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:29.162954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:29.169340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:29.169528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:29.169788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:29.169939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:29.170524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:29.170638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:29.170953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:29.171081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:29.241581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:29.250219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:29.251722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:29.252870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fb55e12-5bb3-4d24-acff-06691852acd0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095072 Jul 11 16:09:29.253428 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1199/2330] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:29.327597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:29.336695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe9f233c-6ccb-4721-8c48-7bdd11f24ffc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.179329 Jul 11 16:09:29.337275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1132/2331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:30.276967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:30.277968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:30.289043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:30.289785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:30.291036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:30.291747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:30.355163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:30.355860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:30.362872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:30.363325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:30.364089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:30.364562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:30.368156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:30.377200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:30.378716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:30.379846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c45bb0fb-f85e-4107-b07c-d161d016df2a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109600 Jul 11 16:09:30.381089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1200/2332] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:30.498168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:30.508691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-18d1b64a-7640-4b35-9cd4-0b8b707668fa tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.157503 Jul 11 16:09:30.509261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1133/2333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:31.404064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:31.405165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:31.414837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:31.415287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:31.416043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:31.416512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:31.492274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:31.501090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:31.502594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:31.503729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aed47236-2dab-4b36-92c8-5f51ba149f38 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107031 Jul 11 16:09:31.504324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1201/2334] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:31.525927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:31.526514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:31.533495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:31.533970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:31.534719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:31.535146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:31.678944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:31.687625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-855951f1-ee3e-460d-9364-0eb4f976e94c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.165653 Jul 11 16:09:31.688215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1134/2335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:32.525394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:32.526113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:32.535112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:32.535590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:32.536758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:32.537233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:32.602109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:32.610916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:32.612452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:32.613593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd20fdcd-1c79-4d21-b1a2-e4abc0c02ef6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094140 Jul 11 16:09:32.614152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1202/2336] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:32.708946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:32.710046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:32.721139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:32.721886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:32.723132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:32.723853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:32.870556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:32.878929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-18646955-a161-497c-9c11-5aeb125e4fca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.176893 Jul 11 16:09:32.879482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1135/2337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:33.635308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:33.636269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:33.647439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:33.648202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:33.649535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:33.650283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:33.727809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:33.736768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:33.738291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:33.739439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7ff4812-20c6-4958-be7a-542c138ee8ae tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.110950 Jul 11 16:09:33.740083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1203/2338] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:33.900893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:33.901803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:33.913001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:33.913753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:33.915008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:33.915736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:34.057714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:34.065896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b3fef30f-b942-4036-85a6-79d41f74f6f3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.171973 Jul 11 16:09:34.066483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1136/2339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:34.761793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:34.762832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:34.774061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:34.774808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:34.776058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:34.776827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:34.783369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:34.851725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:34.860517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:34.862029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:34.863198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1621a7f4-d3a5-4bb4-ae19-2117c1c826d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.108031 Jul 11 16:09:34.863752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1204/2340] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:35.087109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:35.087987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:35.096320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:35.096853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:35.097736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:35.098239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:35.242942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:35.256424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05425cb3-b72d-4d11-bc23-82f2f8d62bb7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.175611 Jul 11 16:09:35.256986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1137/2341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:35.886952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:35.887946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:35.898751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:35.899204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:35.899950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:35.900447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:35.968904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:35.978133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:35.979639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:35.980856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-56a8ef5c-39c0-41b9-a635-8dffe5ce9a20 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101699 Jul 11 16:09:35.981434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1205/2342] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:36.277690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:36.278679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:36.289193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:36.289640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:36.290379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:36.290830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:36.430350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:36.438923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44885a58-0d4a-40a2-bad1-a7277c3d859c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167906 Jul 11 16:09:36.439499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1138/2343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:37.003619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:37.004551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:37.015178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:37.015632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:37.016424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:37.016861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:37.196731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:37.205851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:37.215576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:37.216837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e537221e-db03-4e1c-9f10-16ed56076c31 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.219966 Jul 11 16:09:37.217435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1206/2344] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:37.459725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:37.461030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:37.472277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:37.473077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:37.474335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:37.475355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:37.607349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:37.615513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7108b9cc-f252-4edd-b03c-8ca29cf6543a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162938 Jul 11 16:09:37.616076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1139/2345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:38.234852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:38.235456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:38.242976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:38.243426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:38.244196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:38.244664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:38.311909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:38.321228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:38.322747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:38.323904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9898558a-4744-431e-b8e5-42142cc8aa3a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093176 Jul 11 16:09:38.324490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1207/2346] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:38.632712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:38.633442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:38.641205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:38.641753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:38.642648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:38.643168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:38.794843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:38.806411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-65fa0105-efef-4fc6-841c-4c2fd0caad5c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.178298 Jul 11 16:09:38.806980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1140/2347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:39.347534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:39.348521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:39.360343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:39.361186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:39.362440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:39.363217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:39.427479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:39.436233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:39.437788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:39.438970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ba4a698-42a2-4fd0-bd75-233730350392 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098584 Jul 11 16:09:39.439531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1208/2348] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:39.827830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:39.828923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:39.840608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:39.841346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:39.842635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:39.843346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:39.990049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:39.998278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa7c3dd7-742d-4da3-9b07-30a27d72c6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.177361 Jul 11 16:09:39.998862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1141/2349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:40.466814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:40.467688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:40.477340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:40.477790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:40.478551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:40.478973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:40.546929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:40.560265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:40.562385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:40.564072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4fd34226-bbbf-433f-be7a-9c46f6e18b95 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.105407 Jul 11 16:09:40.564804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1209/2350] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:41.019670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:41.020697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:41.028118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:41.028597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:41.029351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:41.029777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:41.163195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:41.166639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:41.171469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-76ff64b3-0edf-4878-a107-72d59fa50a89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.158619 Jul 11 16:09:41.172012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1142/2351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:41.587286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:41.587980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:41.595644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:41.596122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:41.597000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:41.597499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:41.669812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:41.678779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:41.680300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:41.681438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05e01220-4151-4637-906e-bc87281fc02d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100327 Jul 11 16:09:41.682005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1210/2352] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:42.193864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:42.194401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:42.201563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:42.202014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:42.202776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:42.203208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:42.341504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:42.350019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9839b29c-c929-4328-8371-f1890bfeed18 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163480 Jul 11 16:09:42.350607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1143/2353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:42.709891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:42.710840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:42.721873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:42.722619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:42.723920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:42.724873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:42.803801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:42.812600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:42.814095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:42.815224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57948d9b-e4f9-4370-92c2-11c79919a838 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112760 Jul 11 16:09:42.815781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1211/2354] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:43.370894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:43.371840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:43.383087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:43.383855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:43.385148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:43.385938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:43.523833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:43.531940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b219798a-144b-44cc-8fd4-f122d793ad8a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167755 Jul 11 16:09:43.532548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1144/2355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:43.839042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:43.839979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:43.851994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:43.852791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:43.854062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:43.854791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:43.924672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:43.933986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:43.935459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:43.936680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d28e2ce0-ec00-4219-b88c-3033a4443ed3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.105594 Jul 11 16:09:43.937248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1212/2356] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:44.553473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:44.554519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:44.562332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:44.562783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:44.563542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:44.563977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:44.702310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:44.711131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74a744fb-479b-41d4-8d25-6739ddef64b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.164190 Jul 11 16:09:44.711713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1145/2357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:44.965686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:44.966605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:44.977786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:44.978241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:44.978995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:44.979431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:45.051373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:45.060675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:45.062173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:45.063305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-929a104c-2fab-4940-b059-08420b6df0c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104367 Jul 11 16:09:45.063839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1213/2358] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:45.737074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:45.737856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:45.747008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:45.747619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:45.748665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:45.749247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:45.887075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:45.895693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-30b7f71b-1939-420b-8e3e-9e9160ad8a33 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.163867 Jul 11 16:09:45.896274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1146/2359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:46.085764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:46.086761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:46.094551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:46.094999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:46.095750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:46.096183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:46.169417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:46.178275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:46.179772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:46.180943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0aad78a7-a71d-4c06-81f7-27ab4b31132a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102241 Jul 11 16:09:46.181507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1214/2360] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:46.922552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:46.923429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:46.933950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:46.934396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:46.935145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:46.935556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:47.076005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:47.084897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb83dd49-5951-4382-86e5-a92e3e713a58 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.169327 Jul 11 16:09:47.085501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1147/2361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:47.200188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:47.200862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:47.203319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=54 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:47.209185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:47.209625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:47.210399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:47.210835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:47.275162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:47.283795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:47.285345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:47.286488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83adb2fd-e8af-47cd-baec-e5e986b608a1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090875 Jul 11 16:09:47.287046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1215/2362] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:48.107436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.108551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.114919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.115369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.116109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.116609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.209408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.219984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.226510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.226964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.227739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.228176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.256128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:09:48.267492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:48.275726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-adee5dfc-03d3-4e0e-a375-991a2e79c3ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.172801 Jul 11 16:09:48.285062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1148/2363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:48.285062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.285062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.288695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.289163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.289929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.290363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.304766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a HTTP/1.1 Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:09:48.306466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.308026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'af6fcee3-9b96-4b38-b57e-114c6778e58a'} Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:09:48.309884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.311618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.314140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:09:48.314140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cd36c195-a714-4eb2-b184-ddc2122198ec tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 404 len: 111 microversion: 2.1 time: 0.029803 Jul 11 16:09:48.314140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1149/2364] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:09:48 2022] DELETE /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:09:48.314140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.314544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.320883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.321311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.322083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.322519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.345432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1adf60d6-0f99-4c34-b711-dc86edccc09c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 204 len: 0 microversion: 2.1 time: 0.139823 Jul 11 16:09:48.346113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1216/2365] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:09:48 2022] DELETE /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 16:09:48.353441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.354147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: af6fcee3-9b96-4b38-b57e-114c6778e58a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.361253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.361705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.362474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.362914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.376910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a HTTP/1.1 Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:09:48.378638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.380278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'af6fcee3-9b96-4b38-b57e-114c6778e58a'} Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:09:48.381242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. Jul 11 16:09:48.382716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:09:48.384040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance af6fcee3-9b96-4b38-b57e-114c6778e58a could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:09:48.384040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4ae82633-106b-434c-be42-6f8ff01677e9 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a" status: 404 len: 111 microversion: 2.1 time: 0.032140 Jul 11 16:09:48.384040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1217/2366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:48 2022] GET /compute/v2.1/servers/af6fcee3-9b96-4b38-b57e-114c6778e58a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:09:48.386267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:48.386434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:48.387186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:48.393569 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.394109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.395049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:48.395291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:48.395611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:48.396828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:48.397973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d261ca00-2cdd-4367-9096-694038517d9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088053 Jul 11 16:09:48.398535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1150/2367] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:48.537919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:48.546344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f07f772d-1fae-41b8-8ee1-ae0100979701 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164826 Jul 11 16:09:48.546895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1218/2368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:49.295719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:49.296481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:49.299011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=56 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:49.305093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.305596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.306439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.306915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.416986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:49.417964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:49.424921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.425365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.426128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.426578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.455669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:49.465037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c1556b1-48ba-4bd4-8442-b281028c5907 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.174062 Jul 11 16:09:49.465624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1151/2369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:49.487486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:49.491043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:49.496944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:49.498440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:49.499565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-89181407-c44d-432a-87f6-3dd90ddb5be3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086587 Jul 11 16:09:49.500122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1219/2370] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:49.565868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:49.566703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:49.575133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.575577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.576323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:49.576784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:49.711352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:49.719562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-572976b1-d474-4e80-ad5f-768a30230a69 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.159076 Jul 11 16:09:49.720136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1152/2371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:50.441275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:09:50.442318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:09:50.482735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:50.483355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:50.490512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.490966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.491742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.492178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.517887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:50.518642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:50.525600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.526049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.526797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.527433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.606911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:50.615659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:50.617297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:50.618439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-63c70ea0-79aa-4c89-8b3d-8239901e3c89 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104548 Jul 11 16:09:50.618961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1153/2372] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:50.644851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:50.653173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6f65190b-03b1-4bf8-8c4b-455ca3c83b50 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.174868 Jul 11 16:09:50.653770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1220/2373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:50.740789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:50.741757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:50.749960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.750405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.751151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:50.751583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:50.890922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:50.903400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7314a3fc-75db-4f11-bcbf-0328f892dd3f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169029 Jul 11 16:09:50.904392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1154/2374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:51.640172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:51.641279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:51.649150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.649645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:51.650474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.650956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:51.675133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:51.675782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:51.682849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.683327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:51.684747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.685188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:51.719452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:51.728472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:51.730370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:51.731674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ad75807-2980-4d70-898e-7fb733835ca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097710 Jul 11 16:09:51.732245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1221/2375] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:51.818667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:51.827462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5105caa5-411b-43df-9305-447934487380 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156196 Jul 11 16:09:51.828044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1155/2376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:51.923579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:51.924504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:51.934242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.934696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:51.935457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:51.935897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:52.102545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:52.115566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1ec31a9-7f79-445c-9fa8-dfc4c7681b20 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.197895 Jul 11 16:09:52.116321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1222/2377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:52.754249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:52.755270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:52.766555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:52.767296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:52.768643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:52.769366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:52.838864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:52.845678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:52.846356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:52.849064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:52.850584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:52.851732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44ecbb4d-cc1d-4c9d-bfff-fb391cd48c4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104071 Jul 11 16:09:52.852338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1156/2378] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:52.853339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:52.853794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:52.854568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:52.855003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:53.005498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:53.014158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4decf2a9-fe6c-4911-96cf-62d51832e9a2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.172504 Jul 11 16:09:53.014748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1223/2379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:53.137541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:53.138198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:53.146060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:53.146624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:53.147572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:53.148116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:53.287725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:53.297747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b99f74c8-957a-4e0b-a17b-69a079fab807 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166753 Jul 11 16:09:53.298331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1157/2380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:53.872902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:53.873696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:53.882198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:53.882758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:53.883689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:53.884224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:53.946995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:53.956326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:53.958201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:53.959340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4330d1f0-19d3-45ff-b8b5-0c5418e1076b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091739 Jul 11 16:09:53.959900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1224/2381] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:54.034299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:54.035073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:54.045059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.045667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:54.046704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.047295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:54.191055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:54.199588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5174a235-8e21-48c9-a67f-a1307db13c16 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.170583 Jul 11 16:09:54.200160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1158/2382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:54.315112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:54.315742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:54.322321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.322821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:54.323790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.324520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:54.458311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:54.466538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-daa2d349-2b36-4805-b693-c8ac5bfac42e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.155560 Jul 11 16:09:54.467110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1225/2383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:54.982529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:54.983534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:54.993865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.994605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:54.995946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:54.996476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:55.061213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:55.073957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:55.076424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:55.078099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-324f9624-7039-4c87-81e6-2ab13f04e653 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102234 Jul 11 16:09:55.078876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1159/2384] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:55.218620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:55.219264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:55.226623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:55.227078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:55.227847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:55.228284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:55.370356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:55.381766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-446469e0-d8fc-4f24-b282-174accb1e71b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167236 Jul 11 16:09:55.382702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1226/2385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:55.487664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:55.488752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:55.499121 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:55.499885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:55.501204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:55.501929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:55.508524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:55.641445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:55.653785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e295b1d1-a9aa-46d8-b938-51983ed62b67 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173247 Jul 11 16:09:55.654362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1160/2386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:56.101629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:56.102308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:56.109632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.110088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.110842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.111272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.181622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:56.190571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:56.192066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:56.193244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fff71fcd-0e23-46bc-9e40-68b9bc3b0ffe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096318 Jul 11 16:09:56.193804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1227/2387] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:56.403539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:56.404263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:56.411156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.411608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.412407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.412845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.550870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:56.564271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0824dde4-cac3-41f2-bbea-335103ba8dc9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166668 Jul 11 16:09:56.564895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1161/2388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:56.675001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:56.675966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:56.686602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.687042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.687795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:56.688226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:56.834648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:56.847296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b91116c-b71d-4973-aac4-183fcf5c2f82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.178871 Jul 11 16:09:56.848063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1228/2389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:57.216061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:57.216681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:57.223354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.223798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:57.224578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.225004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:57.288791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:57.298293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:57.299802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:57.300968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4cce58d1-7126-4ee1-b40a-80e42a26165a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091118 Jul 11 16:09:57.301492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1162/2390] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:57.319210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:09:57.319362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:09:57.581455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:57.582446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:57.589077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.589530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:57.590444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.590991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:57.726627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:57.735138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-009b270b-1937-4f1a-bc32-60e4ad7fbdb3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.157594 Jul 11 16:09:57.735723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1229/2391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:57.864944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:57.865524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:57.872346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.872811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:57.873558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:57.873979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:58.012738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:58.021094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ef25d7f-5654-4856-b370-13e1d19ba285 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160072 Jul 11 16:09:58.028737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1163/2392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:58.320628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:58.321379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:58.328563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:58.329014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:58.329764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:58.330196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:58.401361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:58.409956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:58.411456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:58.412620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73d8a99a-731c-4a5f-b037-dad5a9bedfe8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096720 Jul 11 16:09:58.413178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1230/2393] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:58.753677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:58.754282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:58.761776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:58.762424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:58.763328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:58.764004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:58.907563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:58.917207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c6570126-9bd7-4c95-8575-3a232eb2bfda tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.168163 Jul 11 16:09:58.917770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1164/2394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:59.041639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:59.042377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:59.050449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.050929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:59.051734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.052206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:59.216362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:59.225349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf8ceaca-191f-419e-8a81-dc8bec55b83f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.189276 Jul 11 16:09:59.225923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1231/2395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:09:59.431322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:59.431921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:59.438933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.439378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:59.440132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.440588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:59.505633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:59.514493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:59.516072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:09:59.517231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2718e2f2-beaf-4b49-8d6f-f45bd3962e27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090002 Jul 11 16:09:59.517778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1165/2396] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:09:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:09:59.942511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:09:59.943551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:09:59.953298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.953753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:09:59.954545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:09:59.954982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:00.091205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:00.103614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3b09d616-ca2e-45bf-b628-489a0175305f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.167248 Jul 11 16:10:00.104530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1232/2397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:09:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:00.247729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:00.248270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:00.255407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:00.255855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:00.256656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:00.257088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:00.391840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:00.404072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a96769ce-7d4c-429d-a772-5046841008d0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165063 Jul 11 16:10:00.404687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1166/2398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:00.539816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:00.541117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:00.548419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:00.548868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:00.549628 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:00.550061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:00.618665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:00.631712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:00.634182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:00.635312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-730704f4-cff5-47a2-ac66-225a11b6b4a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102672 Jul 11 16:10:00.636153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1233/2399] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:01.121729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:01.122549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:01.129103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.129561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.130323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.130757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.266892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:01.279383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a48bd8b-f3ac-4f0c-8fdb-e4ca15ffa952 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.161361 Jul 11 16:10:01.280124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1167/2400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:01.424098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:01.424838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:01.432822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.433346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.434239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.434751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.577792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:01.586730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8b148a2-1553-48f2-b361-4c21a9dcb490 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.167688 Jul 11 16:10:01.587274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1234/2401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:01.656910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:01.657522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:01.663938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.664419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.665176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:01.665609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:01.737476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:01.746138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:01.748212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:01.749379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7df2b517-aa78-4934-95ab-2a6a4be54add tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097093 Jul 11 16:10:01.749976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1168/2402] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:02.302518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:02.303130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:02.310318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.310763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.311525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.311959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.466084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:02.476559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5a52b033-70f4-498b-82bd-f196c1bf4830 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.178256 Jul 11 16:10:02.477174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1235/2403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:02.604083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:02.604849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:02.611972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.612444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.613233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.613703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.759002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:02.768976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24e482e7-1541-4694-a6bd-88bab0ea429a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169236 Jul 11 16:10:02.769742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1169/2404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:10:02.776446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:02.777251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:02.784931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.785380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.786148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:02.786586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:02.809922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:02.866702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:02.876185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:02.877748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:02.878898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5171c64c-27d3-4b35-9aa8-aa81afec0229 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109458 Jul 11 16:10:02.879464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1236/2405] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:10:03.497805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:03.498320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:03.504912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.505362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.506122 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.506552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.646084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:03.658817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-142ee99c-e443-44c3-8ffa-e7058c41eb89 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166939 Jul 11 16:10:03.659649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1170/2406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:03.791866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:03.793210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:03.800667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.801167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.802010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.802491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.898544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:03.899257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:03.905601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.906052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.906812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:03.907250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:03.943420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:03.951892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5270b96d-97cd-4b59-96bb-53f91e6aa4c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166574 Jul 11 16:10:03.952511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1237/2407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:03.975587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:03.984908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:03.986428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:03.987550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2fc195f2-60c3-480c-9a97-6cc056ff3c92 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092960 Jul 11 16:10:03.988103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1171/2408] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:10:04.683570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:04.684675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:04.691408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:04.691880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:04.692705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:04.693143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:04.835212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:04.843646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15e2b0ce-d342-46b7-9f99-d47917f7b81c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166633 Jul 11 16:10:04.844205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1238/2409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:04.971687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:04.972397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:04.980576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:04.981466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:04.981967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:04.982469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:05.006207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:05.006824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:05.013147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:05.013599 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:05.014360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:05.014796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:05.098184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:05.107118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:05.108672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:05.109824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-10475dca-b276-4f94-8671-0c8bc5b253c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107580 Jul 11 16:10:05.110398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1239/2410] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:05.138075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:05.146448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5dff723c-838b-4b17-894b-20347005db10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.179404 Jul 11 16:10:05.147017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1172/2411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:05.865993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:05.866995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:05.878383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:05.879140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:05.880400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:05.881178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:06.018630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:06.031181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2e8e2c8b-269c-4db9-84ca-d15e90146bd2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.171543 Jul 11 16:10:06.032121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1240/2412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:06.132812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:06.133596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:06.145094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:06.145850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:06.147111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:06.147846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:06.163839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:06.164510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:06.171593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:06.172042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:06.172900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:06.173336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:06.218379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:06.227409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:06.228941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:06.230114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-df2218cc-5ca2-42c6-b6ca-c191e00011a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104290 Jul 11 16:10:06.230678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1173/2413] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:06.314631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:06.323884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8c54116-bdaf-4d08-a7c8-5a54915dcd8b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163982 Jul 11 16:10:06.324532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1241/2414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:07.052664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:07.053586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:07.062445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.062895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.063634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.064064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.210931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:07.219411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-274a0893-98bd-4725-a178-da5258b10521 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173329 Jul 11 16:10:07.220009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1174/2415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:07.251161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:07.252080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:07.261356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.262062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.263347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.263927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.327037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:07.337897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:07.339434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:07.340601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80ac42fa-60cb-4522-b3ed-a76f4391ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095737 Jul 11 16:10:07.341353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1242/2416] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:07.345198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:07.345817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:07.355060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.355796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.357635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:07.358058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:07.517360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:07.525573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-664d6c40-1547-4f35-bb4b-ca47528b1d1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.187586 Jul 11 16:10:07.526141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1175/2417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:10:08.237441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:08.238086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:08.244842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.245278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.246060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.246504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.362144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:08.362741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:08.370411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.370898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.371664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.372103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.398394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:08.407314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-183c199d-bc0f-4b77-96f7-67d98dd2d00d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.173799 Jul 11 16:10:08.407954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1243/2418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:08.435628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:08.439080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:08.444891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:08.446440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:08.447557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3a823745-1fe5-4f63-b8c6-a66eb71281fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089466 Jul 11 16:10:08.448119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1176/2419] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:08.543316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:08.543928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:08.550754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.551203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.551968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:08.552488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:08.692190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:08.705709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5afd3157-f1a2-43af-b718-41f463b93d3e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166091 Jul 11 16:10:08.706996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1244/2420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:09.428702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:09.429665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:09.439885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.440240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.441036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.441473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.466133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:09.467171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:09.473626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.474079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.474842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.475278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.542202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:09.551607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:09.553277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:09.554420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6163a929-a5f0-4af4-8ed2-10cef309e493 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092323 Jul 11 16:10:09.554992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1245/2421] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:09.602091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:09.610503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6106f940-e87a-4596-af40-4bfe5672d4d8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.188414 Jul 11 16:10:09.611045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1177/2422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:09.730700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:09.731583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:09.738299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.738744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.739493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:09.739918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:09.873843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:09.881944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f80baaf-6972-4e96-8572-92cd6194cfe1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.157809 Jul 11 16:10:09.882514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1246/2423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:10.576812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:10.577426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:10.584719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.585159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:10.585907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.586332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:10.634259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:10.634885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:10.641788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.642240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:10.642999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.643432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:10.651465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:10.661081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:10.662586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:10.663708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-499eb494-65c1-46b8-8499-fe678372cf37 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093496 Jul 11 16:10:10.664266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1178/2424] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:10.777819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:10.786622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9aee54c0-84db-4509-a0a9-70f0105246f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156808 Jul 11 16:10:10.787174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1247/2425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:10.903038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:10.904032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:10.910711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.911178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:10.911964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:10.912460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:11.061909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:11.070699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27628f03-1083-4afa-a143-006703d9962d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.174196 Jul 11 16:10:11.071275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1179/2426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:11.587401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:10:11.588387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:10:11.685784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:11.686400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:11.693512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:11.693969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:11.694717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:11.695152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:11.758860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:11.769367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:11.770861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:11.771996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-022ab464-4cb1-4897-933b-f2269d22b781 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092606 Jul 11 16:10:11.772555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1248/2427] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:11.803977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:11.804636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:11.812016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:11.812504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:11.813280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:11.813708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:11.952541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:11.965851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a16a4eba-9b63-4c4b-a2b7-b70383d0386a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.165395 Jul 11 16:10:11.966665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1180/2428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:12.092939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:12.093942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:12.104153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:12.104955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:12.106184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:12.106986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:12.247007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:12.255639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0ac88661-680d-45a4-95b6-c875d6ebfc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169318 Jul 11 16:10:12.256208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1249/2429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:12.793739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:12.794884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:12.801900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:12.802392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:12.803249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:12.803690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:12.878309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:12.892692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:12.895049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:12.896773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e56f5cdc-a5e9-4ba8-af4e-ff3204a5e74c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109481 Jul 11 16:10:12.897630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1181/2430] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:12.987203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:12.988159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:12.998980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:12.999439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.000196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:13.000658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.273334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:13.273971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:13.280594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:13.281040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.281799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:13.282225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.446495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:13.454202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:13.454940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7923129f-433b-4d15-867f-6ff82cc0ca44 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.474450 Jul 11 16:10:13.455499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1250/2431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:13.463047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-61967d35-b9b2-4fc9-af71-1d1b3b73dec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.193641 Jul 11 16:10:13.463602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1182/2432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:13.919979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:13.920702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:13.930941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:13.931673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.932983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:13.933694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:13.999968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:14.012790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:14.014686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:14.015846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7aa194e-351e-400d-8ae9-c88ea97ebf96 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103041 Jul 11 16:10:14.016430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1251/2433] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:14.474320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:14.475067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:14.479974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:14.481213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:14.481504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:14.481957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:14.482727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:14.483165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:14.488130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:14.488601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:14.489614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:14.490056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:14.676737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:14.680796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:14.685275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6e862a88-e58b-48bd-8dd2-da7122472073 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.215689 Jul 11 16:10:14.685849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1183/2434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:14.689751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97794abe-558b-4e37-bb17-7704e820f612 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.213614 Jul 11 16:10:14.690441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1252/2435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:15.038425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:15.039437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:15.047921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.048398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.049160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.049600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.119959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:15.129347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:15.130840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:15.131969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef486008-5add-426f-8d99-dd326f3f785d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100156 Jul 11 16:10:15.132586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1184/2436] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:15.705166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:15.705795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:15.708694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:15.709388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:15.714414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.714937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.715839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.716550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.718403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.718952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.719866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:15.720469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:15.721761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:15.914837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:15.918053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:15.923960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aeb4c221-9ed6-442d-af9b-2fdf691ba65e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224033 Jul 11 16:10:15.924661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1253/2437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:15.926586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b27d569f-7fa2-41f3-af45-be6b161554f3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222923 Jul 11 16:10:15.927144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1185/2438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:16.154702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:16.155409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:16.162553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.163046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:16.163890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.164396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:16.243440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:16.256884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:16.259289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:16.261120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83aaa4b2-c308-462d-93ed-7c3297e3c510 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112709 Jul 11 16:10:16.261947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1254/2439] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:16.945080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:16.945965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:16.947687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:16.948750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:16.957955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.958679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:16.959966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.960197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.960724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:16.960986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:16.961978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:16.962705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:17.162839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:17.166079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:17.171421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-01cdb1a9-bdd2-4422-be7c-265ee6062107 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.232943 Jul 11 16:10:17.172009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1186/2440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:17.175306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eea9c78a-3c97-4f7f-9902-2fd13955c0fb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.234194 Jul 11 16:10:17.175873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1255/2441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:17.285089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:17.285937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:17.296027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:17.296521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:17.297277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:17.297708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:17.363997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:17.373059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:17.374581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:17.375716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c089a51e-0f80-4d69-bd86-521ec9f70489 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098171 Jul 11 16:10:17.376332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1187/2442] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:18.193298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:18.195057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:18.196211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:18.197238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:18.204362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:18.208280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.208609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.209072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.209624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.210325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.210895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.211152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.211616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.405423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:18.408608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:18.413611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e04851b1-5ab0-4ba3-9512-4b49b1e5bd9c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223974 Jul 11 16:10:18.414492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1188/2443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:18.417704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aee723ca-37fa-470d-b084-a75f66b2ed77 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.231109 Jul 11 16:10:18.418492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1256/2444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:18.422626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:18.423245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:18.429345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.429787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.430537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:18.430966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:18.493247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:18.504461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:18.505968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:18.507157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a431938f-b2a9-4d1d-bdbe-71d0d3d59991 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091779 Jul 11 16:10:18.507727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1189/2445] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:19.435815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:19.436802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:19.438566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:19.439845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:19.443936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:19.448364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.449119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.450333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.450933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.452897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.453350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.454316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.454850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.649425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:19.654641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:19.659588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f05b855-9b3e-44a1-8ee8-f84fb7ce63aa tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.231024 Jul 11 16:10:19.660255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1257/2446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:19.663138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c9d03e6d-8ee8-427c-836d-fa66872161ec tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.230915 Jul 11 16:10:19.663864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1190/2447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:19.664964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:19.665629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:19.672036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.672529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.673283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:19.673750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:19.738805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:19.747460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:19.749007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:19.750146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97758d76-f5a9-4a59-b206-32cb87beb5f8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088840 Jul 11 16:10:19.750718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1258/2448] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:20.681462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:20.682424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:20.684678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:20.685509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:20.690104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.690553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.691306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.691734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.692365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.692845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.693587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.694041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.884832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:20.889353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:20.894326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-268bc321-9b93-4fac-8ac7-1a387c6ec455 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.219379 Jul 11 16:10:20.895168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1191/2449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:20.898309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-729b739c-9771-4ca0-9737-a4db63656db1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220122 Jul 11 16:10:20.899066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1259/2450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:20.899353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:20.900100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:20.906515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.906967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.907717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:20.908144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:20.968889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:20.977245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:20.978736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:20.979860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-622fe344-3445-4c57-8e13-fd50b2cfb8fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.084060 Jul 11 16:10:20.980430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1192/2451] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:21.917374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:21.918811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:21.920895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:21.921905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:21.931649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:21.932078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:21.932222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:21.932573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:21.932905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:21.933348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:21.933451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:21.933777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:21.952504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:22.127342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:22.131635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:22.138684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f49e2ad1-77b7-4237-b9b2-27aa4d022c5b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.229595 Jul 11 16:10:22.139237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1260/2452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:10:22.144581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:22.145181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:22.151100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b429179-033b-47b8-9fa2-f4db05fff1c1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.238075 Jul 11 16:10:22.151280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:22.151705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1193/2453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:22.151877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:22.152618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:22.153050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:22.217168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:22.238072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:22.239592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:22.240827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-873fd074-5517-49ee-98be-efbcdd7e79d3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099890 Jul 11 16:10:22.241465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1261/2454] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:23.160176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:23.161206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:23.171998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.172324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:23.172844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.172962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:23.173220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.173655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.180071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.180545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.181296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.181724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.374614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:23.381918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:23.384667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8253d34a-28b1-4f12-9a94-456741891cdc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.230897 Jul 11 16:10:23.385613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1194/2455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:23.391046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f051d8c7-1a13-4bc7-a84b-8ca6cb9b00b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225321 Jul 11 16:10:23.391774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1262/2456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:23.393557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:23.394612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:23.402321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.402790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.403577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:23.404009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:23.469225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:23.478115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:23.479598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:23.480753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a221ba2c-133d-43f6-a1d0-41cd86eaf663 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093858 Jul 11 16:10:23.481303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1195/2457] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:24.404611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:24.405362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:24.411033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:24.411695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:24.412409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.412923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.413743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.414263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.418656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.419106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.419872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.420281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.615692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:24.618447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:24.624538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0d196ba-e80d-4e95-9962-c1f7aeb09470 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223793 Jul 11 16:10:24.625188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1263/2458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:24.626542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fcbe3b83-eacb-4e47-8e48-674a2bf017bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219583 Jul 11 16:10:24.627402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1196/2459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:24.630070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:24.630766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:24.636990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.637522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.638260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:24.638702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:24.703536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:24.713017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:24.714535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:24.715684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-429f4c8d-2d9f-4d1d-9abe-ce63e5fe2d33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089438 Jul 11 16:10:24.716253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1264/2460] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:25.646242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:25.647169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:25.647801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:25.648336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:25.657777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.658195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.658374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.658624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.658978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.659412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.659576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.659829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.853171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:25.857070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:25.865167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c3a325b-9c0c-49c9-9200-48a5ad5bd657 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225404 Jul 11 16:10:25.865921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1197/2461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:25.867669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a340e37f-0b91-4c0a-9554-5926c29c741a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227219 Jul 11 16:10:25.868355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1265/2462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:25.870431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:25.871000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:25.877666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.878110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.878875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:25.879328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:25.943782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:25.952438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:25.954190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:25.955325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-09e14123-3035-4808-be17-ab263abb49b1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088486 Jul 11 16:10:25.955910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1198/2463] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:26.886818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:26.887735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:26.888029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:26.889102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:26.896433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:26.896726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:26.896891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:26.897182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:26.897626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:26.897948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:26.898096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:26.898383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:27.090497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:27.093952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:27.098997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-922b5690-e28a-4603-9e7e-3b6c9dd89828 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.218987 Jul 11 16:10:27.099982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1266/2464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:27.102825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a258cf38-4f83-430d-bd5d-6974ce8efe27 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221047 Jul 11 16:10:27.103374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1199/2465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:27.104274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:27.104900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:27.110971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:27.111413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:27.112157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:27.112625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:27.173476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:27.182537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:27.184079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:27.185260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c3462284-d573-4c54-84a1-50d05d67156a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.084485 Jul 11 16:10:27.185820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1267/2466] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:28.120032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:28.120953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:28.122214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:28.123158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:28.129390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.129825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.130580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.130926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.131097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.131381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.132118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.132579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.327664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:28.331114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:28.336665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-61db412f-7d0c-47c1-99ac-0a7155bbcc2a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222759 Jul 11 16:10:28.337481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1200/2467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:28.342263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:28.343087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:28.347082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4df6b6af-dc9e-4ef5-821a-d59c888b0aa2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223943 Jul 11 16:10:28.347712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1268/2468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:28.349144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.349601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.350365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:28.350800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:28.416212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:28.425471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:28.426975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:28.428114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0197f724-8348-4475-bd7a-7304d1b0f3fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089685 Jul 11 16:10:28.428715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1201/2469] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:29.358491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:29.360074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:29.367927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:29.368982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:29.370889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.371930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.373814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.374220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.378176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.378655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.379414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.379846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.571520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:29.580706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1011422f-f73d-44dc-a305-c08e7e28191d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.218958 Jul 11 16:10:29.583674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:29.584466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1202/2470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:29.587315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:29.589439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:29.590333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:29.592555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c819b0d-2178-4585-a3d7-b0e44401686e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.240728 Jul 11 16:10:29.593206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1269/2471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:29.597263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.597714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.598479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:29.598908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:29.660486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:29.669093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:29.670620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:29.671777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f48f6267-41ae-42d2-b8d5-17e8f1167968 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086205 Jul 11 16:10:29.672357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1203/2472] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:30.604817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:30.604817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:30.611578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:30.612212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:30.612986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.613449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.614214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.614652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.618908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.619349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.620098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.620554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.815403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:30.818880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:30.823640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-218fbe7b-0ec3-41ba-9d5a-9b07a1d1d7ae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227632 Jul 11 16:10:30.824216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1270/2473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:30.831199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-173de665-6d87-49a8-829f-bbc2f55bfffd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220944 Jul 11 16:10:30.831199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1204/2474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:30.831429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:30.831429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:30.836050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.836460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.837210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:30.837642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:30.904878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:30.914261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:30.915752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:30.916924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2adc4e0f-bd2e-4c38-bde6-5b73c3eabddf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091778 Jul 11 16:10:30.917463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1271/2475] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:31.846325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:31.846970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:31.848561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:31.849172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:31.855224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:31.855682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:31.855962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:31.856462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:31.856586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:31.856945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:31.857250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:31.857684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:32.049113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:32.053531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:32.059386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7aa94743-bda6-4631-a77d-8cb9fd821099 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.215375 Jul 11 16:10:32.059966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1272/2476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:32.061898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cbd504fe-1b78-458b-a24f-405fe42a0ba9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222517 Jul 11 16:10:32.062632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1205/2477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:32.064544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:32.065148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:32.071133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:32.071577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:32.072350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:32.072784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:32.135041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:32.144830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:32.146369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:32.147509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cab8575c-2f5f-4c10-a2cd-bf3903e98f88 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086601 Jul 11 16:10:32.148108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1273/2478] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:33.081175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:33.082639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:33.083825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:33.084875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:33.093291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.094070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.095402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.095951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.096108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.096586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.097328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.097844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.289391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:33.292739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:33.297523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d12e3918-7c45-43a0-b3c8-103958f20a5f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223964 Jul 11 16:10:33.298104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1206/2479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:33.301534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0988b790-36e0-4b7d-af86-e3d1c92b9db4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225403 Jul 11 16:10:33.302364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1274/2480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:33.306650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:33.307270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:33.313411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.313936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.314713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:33.315193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:33.384714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:33.398994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:33.400878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:33.402556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21f78850-b4e0-48f1-bfae-c3faccc0bad6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103245 Jul 11 16:10:33.403349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1207/2481] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:34.318279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:34.319103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:34.320725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:34.321485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:34.327411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.327966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.329425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.329704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.329865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.330265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.331034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.331455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.526584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:34.531371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:34.539334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6fe1b162-94c7-4c9b-9522-e3cff2c28e0d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225742 Jul 11 16:10:34.540320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1275/2482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:34.543428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e28608d5-ce97-4452-8f4f-3d00f01e80ac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227673 Jul 11 16:10:34.544331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1208/2483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:34.545042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:34.545710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:34.552704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.553151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.553910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:34.554344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:34.618730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:34.627568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:34.629121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:34.630256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d457cc5e-cedb-4ec9-a614-6a78c4e45685 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088957 Jul 11 16:10:34.630819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1276/2484] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:35.560975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:35.561952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:35.564540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:35.565159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:35.570133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.570576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.571352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.571807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.571986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.572576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.573339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.573772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.769864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:35.773065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:35.780146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2249c25-953b-4385-8595-8008b54bf62c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222056 Jul 11 16:10:35.780799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1277/2485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:35.781918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7cc54907-7dc5-4dc4-9b7c-eefb6c7d3870 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227371 Jul 11 16:10:35.782892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1209/2486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:35.785502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:35.786106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:35.793406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.794042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.795208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:35.795831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:35.858125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:35.866965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:35.868520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:35.869658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-600cf58c-308e-428a-82db-1117bab6b573 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087953 Jul 11 16:10:35.870225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1278/2487] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:36.800394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:36.801114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:36.801759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:36.802369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:36.807778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:36.808222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:36.808962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:36.809111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:36.809413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:36.809535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:36.810158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:36.810590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:36.813364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:37.007343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:37.011441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:37.020192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3a66489f-ca02-4790-a4ac-27761ba4f7d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222708 Jul 11 16:10:37.020945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1279/2488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:37.022178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5daed2e-c860-4966-9738-0ff80a8a7068 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227179 Jul 11 16:10:37.022709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1210/2489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:37.025477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:37.026048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:37.033273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:37.033727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:37.034496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:37.034932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:37.109421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:37.121153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:37.123378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:37.125108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d391ab39-7ad7-4804-b805-b50089fe8643 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102956 Jul 11 16:10:37.125872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1280/2490] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:38.038610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:38.039250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:38.039639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:38.039748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:38.047702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.047941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.048323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.048831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.049065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.049185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.049537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.049701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.251585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:38.255669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:38.263485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-16ef6db9-acec-4a2f-ba40-84d31301411b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.228112 Jul 11 16:10:38.264163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1281/2491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:38.269306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ad35571-34ef-40ea-9c7c-0996c3e535ec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232122 Jul 11 16:10:38.269306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1211/2492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:38.269519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:38.269519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:38.275625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.276113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.276892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:38.277319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:38.346602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:38.356408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:38.357917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:38.359082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a8a1e98-7453-4740-a772-17a5286b8759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093952 Jul 11 16:10:38.359652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1282/2493] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:39.284223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:39.284851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:39.285201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:39.285809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:39.291254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.291711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.292322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.292469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.292810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.292951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.293561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.293990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.489848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:39.494554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:39.502200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4b5ae41-185d-4747-8c16-4784d76fe147 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221623 Jul 11 16:10:39.503034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1283/2494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:39.505609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9c9f194-ae13-4397-98d3-ae80cfe3d8ef tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227899 Jul 11 16:10:39.507448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1212/2495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:39.507779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:39.508742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:39.517667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.518118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.518881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:39.519318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:39.591589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:39.601154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:39.602647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:39.603787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1dafd226-18b8-4639-9c37-e0492521a0b4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099751 Jul 11 16:10:39.604333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1284/2496] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:40.529650 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:40.530525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:40.530952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:40.531955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:40.541502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.542262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.543531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.544259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.544570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.545234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.546489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.547206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.737542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:40.740638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:40.746112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f550139-cdd8-48d3-8ca4-d174e2afe3fd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223208 Jul 11 16:10:40.746737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1213/2497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:40.749566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c8d72d94-5e2e-466c-96b6-1f92400688f7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224965 Jul 11 16:10:40.750292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1285/2498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:40.751231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:40.752075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:40.758092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.758531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.759296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:40.759735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:40.822165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:40.830703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:40.832703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:40.833827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1d26782e-8258-4878-9346-0f6970988651 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086184 Jul 11 16:10:40.834392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1214/2499] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:41.767427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:41.768229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:41.769552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:41.770169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:41.775071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.775525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:41.776303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.776753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:41.776898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.777380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:41.778134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.778562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:41.795389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:41.973424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:41.977647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:41.981857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b81df59e-829c-4b5b-8cc2-828e83091a0c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221184 Jul 11 16:10:41.982413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1286/2500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:41.986734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ed54d15d-def0-46d1-9e25-6ea2012a37c0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222363 Jul 11 16:10:41.992408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1215/2501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:41.992617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:41.992617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:41.994513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.994967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:41.995726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:41.996161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:42.067468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:42.078986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:42.080501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:42.081976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-679b4bfb-d8d8-4ae9-8c24-fc27b834ecd2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098279 Jul 11 16:10:42.082531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1287/2502] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:43.004064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:43.005152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:43.006136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:43.006912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:43.012065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.012589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.013431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.013901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.014210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.014715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.015582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.016082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.214135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:43.217500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:43.222621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c49c4c5-975d-4bd0-85c9-d12e04e351ed tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225473 Jul 11 16:10:43.223213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1216/2503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:43.227090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cb4d94d1-ca43-4a71-9427-109645006bd9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225453 Jul 11 16:10:43.236544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1288/2504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:43.236720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:43.236720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:43.236720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.236720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.237099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:43.237099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:43.303598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:43.318018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:43.320418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:43.322139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf6318d9-2c23-41b0-9651-e2cdd57e32f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097698 Jul 11 16:10:43.322889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1217/2505] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:44.241757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:44.242499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:44.245368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:44.246269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:44.251666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.252468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.253480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.254062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.255275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.255867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.256885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.257468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.447970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:44.457339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-69ddb79c-33ac-4490-981b-b0ae2683012b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220576 Jul 11 16:10:44.457926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1289/2506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:44.460254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:44.462587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:44.463187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:44.468832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f37f46ff-798f-4fd4-ad7e-66be113a3b0d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.228763 Jul 11 16:10:44.469147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.469674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1218/2507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:44.470149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.471091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:44.471526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:44.546894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:44.556457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:44.557966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:44.559115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97f98df1-fb50-461c-a998-1b5499a258fb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100246 Jul 11 16:10:44.559681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1290/2508] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:45.479461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:45.480329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:45.488459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:45.489068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:45.489530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.489972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:45.490700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.491159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:45.495624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.496073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:45.496852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.497282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:45.935193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:45.939461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:45.944825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0bc66161-2f0c-4048-b1c3-17314ed6aa45 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.472033 Jul 11 16:10:45.945655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1219/2509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:45.948465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ab4e68e-5f32-4dce-826d-29c6b4d7cf84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.464908 Jul 11 16:10:45.949217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1291/2510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:45.949878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:45.950435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:45.957070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.957510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:45.958260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:45.958679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:46.022622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:46.031427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:46.033207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:46.034499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1fa6ffb-1787-4607-ac79-e2ffeb492e7c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088202 Jul 11 16:10:46.035061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1220/2511] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:46.966088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:46.966982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:46.969685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:46.971429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:46.977844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:46.978631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:46.979836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:46.980600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:46.982400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:46.983179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:46.984618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:46.985381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:47.121486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:47.129836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f328eaeb-59c2-46d2-9cd8-aea563637fb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.170551 Jul 11 16:10:47.130434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1292/2512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:47.135658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:47.136264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:47.142860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:47.143302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:47.144059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:47.144515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:47.220394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:47.229061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:47.230526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:47.231700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b0aaf51-c8b9-437a-a840-02b60fc863bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100196 Jul 11 16:10:47.232247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1293/2513] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:47.255219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:47.263685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d45aba0-7ed2-40ac-b7db-b9f6b212687f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.300465 Jul 11 16:10:47.264227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1221/2514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:48.151623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:48.152706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:48.161269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.161732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.162494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.162932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.251816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:48.252528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:48.259112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.259547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.260313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.260789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.310955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:48.319751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ade153d-5dc6-4dd3-8623-1c4497b4fcf9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175102 Jul 11 16:10:48.320373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1294/2515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:48.325345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:48.325947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:48.328691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=78 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:48.331341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:48.334003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.334438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.335216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:48.335642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:48.340632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:48.342224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:48.343449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74061cdd-e9ec-473e-ba79-c7897b7fb608 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095810 Jul 11 16:10:48.344058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1222/2516] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:48.467703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:48.475994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-978dfd84-a3e7-4cdd-8d1e-cf95a10a5095 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.154680 Jul 11 16:10:48.476591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1295/2517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:49.341872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:49.342840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:49.354018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.354759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.355967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.356790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.364588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:49.365234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:49.372327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.372806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.373594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.374325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.465789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:49.475072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:49.476588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:49.477760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d8fe134-294a-48e3-b726-da7311940dd9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.118485 Jul 11 16:10:49.478352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1296/2518] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:10:49.493853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:49.494524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:49.501067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.501595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.502818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:49.503356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:49.526428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:49.535468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-02d1fa95-5fb9-48c1-bd8e-66203cfff7dc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.200310 Jul 11 16:10:49.536072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1223/2519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:49.638702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:49.646849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-73ff892a-af51-4d52-9625-c3ebade6c778 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156821 Jul 11 16:10:49.647413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1297/2520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:50.500450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:50.501339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:50.504107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=68 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:50.509655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.510094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.510852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.511278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.553627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:50.554249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:50.561193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.561639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.562397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.562827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.575248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:50.585532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:50.587157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:50.588720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ce8df28b-8b0d-4ddb-8d3c-179b2d96de8e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094716 Jul 11 16:10:50.589355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1224/2521] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:50.663985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:50.664612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:50.671076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.671544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.672340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:50.672791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:50.697841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:50.706098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4fc3e70-e438-48f2-a292-02d5ae860560 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.157464 Jul 11 16:10:50.707078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1298/2522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:50.801549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:50.815676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b28e539f-e136-48a3-9e00-57ff40ec2416 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.155376 Jul 11 16:10:50.816448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1225/2523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:10:51.612420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:51.613034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:51.619887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.620321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.621112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.621543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.694125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:51.703115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:51.704641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:51.706018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14b6534e-188d-4a0c-965b-37ed134cf0d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099980 Jul 11 16:10:51.706881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1299/2524] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:51.722977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:51.723597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:51.730639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.731086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.731883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.732326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.833544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:51.834192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:51.840434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.840882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.841632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:51.842080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:51.863463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:51.866853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:51.872728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a721a5b9-7139-4fc6-ac2c-a4b23b8f7b7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.153648 Jul 11 16:10:51.873299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1226/2525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:51.978861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:51.991647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fb79406-8dc7-44a1-afb2-86947307fce4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162081 Jul 11 16:10:51.992451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1300/2526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:52.732568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:52.733569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:52.744879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:52.745621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:52.746819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:52.747577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:52.815385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:52.824326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:52.825851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:52.826999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-28e25c76-597c-4ea6-89da-8d1c0c530878 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101068 Jul 11 16:10:52.827580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1227/2527] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:52.893721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:52.894279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:52.901299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:52.901744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:52.902498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:52.902931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:53.016138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:53.016790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:53.022882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:53.023332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:53.024089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:53.024551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:53.033287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:53.041908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c921549-4d9a-4991-9e1f-a478600723b8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.154624 Jul 11 16:10:53.042501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1301/2528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:53.157124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:53.168903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-402677e3-d102-4625-b3fb-c65968b291be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156298 Jul 11 16:10:53.169621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1228/2529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:53.850970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:53.851976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:53.862809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:53.863254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:53.864009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:53.864482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:53.932205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:53.941308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:53.942906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:53.943954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8910720a-7a74-4271-8d65-64ae92fc4039 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100669 Jul 11 16:10:53.944535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1302/2530] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:54.059926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:54.060586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:54.067898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.068384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:54.069130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.069558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:54.187997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:54.188774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:54.195482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.196313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:54.196754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.197163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:54.201699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:54.212092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:54.220186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2fe6bc58-aec1-4147-b74a-f96641df3887 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164648 Jul 11 16:10:54.220843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1229/2531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:54.337906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:54.346493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-93e1b610-73f9-45a5-ab9a-e66a6e94fda9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.162451 Jul 11 16:10:54.347084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1303/2532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:54.966977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:54.967829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:54.975656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.976102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:54.976856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:54.977306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:55.042973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:55.051678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:55.053167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:55.054292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-52d70651-30df-442d-a384-6f0463e675f4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094189 Jul 11 16:10:55.054881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1230/2533] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:55.237545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:55.238069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:55.245170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:55.245625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:55.246390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:55.246851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:55.363523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:55.364092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:55.370971 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:55.371421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:55.372178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:55.372638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:55.389250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:55.397702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-61a08dbb-ed4d-4116-b236-ca97d5185f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164226 Jul 11 16:10:55.398293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1304/2534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:55.503508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:55.511584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-257ccca0-4c52-42a4-a659-cfc2cdf6880d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.152201 Jul 11 16:10:55.512130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1231/2535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:56.073474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:56.074080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:56.080814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.081259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.082341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.082778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.151955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:56.164740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:56.167076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:56.168780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f310e188-ca06-42d0-8b97-1112b238fd63 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098958 Jul 11 16:10:56.169510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1305/2536] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:56.419489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:56.420611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:56.432146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.432983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.434221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.434933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.528939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:56.529538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:56.537120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.537573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.538344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:56.538764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:56.567746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:56.577473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0680e96e-f2e4-4899-be81-f18f176d683b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164553 Jul 11 16:10:56.577991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1232/2537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:56.673112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:56.681956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4649e257-9cd4-4fd3-9648-24b71d8e33f9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.156919 Jul 11 16:10:56.682537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1306/2538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:57.191648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:57.192260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:57.198766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.199209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.199969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.200428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.265300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:57.274345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:57.275833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:57.276997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5bf2f980-c525-437a-94ff-1486f225a80d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090910 Jul 11 16:10:57.277550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1233/2539] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:57.599857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:57.600979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:57.612141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.612622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.613381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.613806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.699266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:57.699904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:57.707287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.707676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.708438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:57.708909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:57.788412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:57.797520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-10ba7149-9c0f-46dc-93df-a8ca9425983c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.204811 Jul 11 16:10:57.798116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1307/2540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:57.853375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:57.862262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1305e376-b765-4d81-bed7-b1a3c9cf691d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.166985 Jul 11 16:10:57.862803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1234/2541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:58.299471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:58.300719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:58.308319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.308787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:58.309539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.309971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:58.385632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:58.394885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:58.396409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:58.397545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d182665-e5a2-4579-af40-16cfd3dd636c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104756 Jul 11 16:10:58.398110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1308/2542] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:10:58.822037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:58.823075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:58.835029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.835779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:58.837174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.837896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:58.885323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:58.886067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:58.893351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.893745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:58.894526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:58.894967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:59.033944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:59.042488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11bba240-083c-478f-a285-535e8f8ba252 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227384 Jul 11 16:10:59.052513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1235/2543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:59.063768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:59.072990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f3b46eb-0d83-4433-b304-84cec1fbb616 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.191574 Jul 11 16:10:59.073522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1309/2544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:10:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:10:59.421793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:10:59.422498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:10:59.435039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:59.435597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:59.436498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:10:59.437000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:10:59.504651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:59.513389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:59.514895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:10:59.516063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d78a9fa5-0fb7-4068-a808-37ac6535f570 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098351 Jul 11 16:10:59.516671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1236/2545] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:10:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:00.062388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:00.063215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:00.071059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.071508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.072283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.072750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.091243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:00.091879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:00.099320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.099766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.100561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.100989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.264257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:00.273028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-58f92cc3-f5d4-4d38-8500-9b38896cf9ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.215893 Jul 11 16:11:00.273611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1310/2546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:00.275554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:00.284240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-814405cc-9dc1-4b46-ae1e-4207273205a7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.196956 Jul 11 16:11:00.284820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1237/2547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:00.538596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:00.539604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:00.549723 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.550176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.550939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:00.551356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:00.628326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:00.637648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:00.639220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:00.640398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67f24289-df5b-4ae5-bf8d-b6e2e3979885 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.108518 Jul 11 16:11:00.640982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1311/2548] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:01.294984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:01.296057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:01.303124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:01.303708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:01.304328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.304787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.305548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.305979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.310629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.311094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.311856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.312321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.500239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:01.507728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:01.509358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c77dc496-81ca-4e93-8b45-a9cd8c0cce93 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220948 Jul 11 16:11:01.509936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1238/2549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:01.515935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f37e52bb-46bd-4398-86ab-99f7e240c731 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.217170 Jul 11 16:11:01.516565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1312/2550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:01.662581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:01.663384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:01.672794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.673379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.674255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:01.674883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:01.745449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:01.755466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:01.757193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:01.758363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe721516-d09d-4c67-9ac8-4217e8103f51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102328 Jul 11 16:11:01.758923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1239/2551] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:02.529543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:02.530158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:02.537406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:02.538874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.539326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.539601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:02.540097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.540561 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.549581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.550036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.550911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.551376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.761481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:02.769705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:02.770230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d8d8949d-5749-4d49-828e-16ef344798f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.246755 Jul 11 16:11:02.771245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1313/2552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:02.778373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:02.779265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:02.779645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e3687a47-2464-4b75-a174-a10eda7f8de3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.246397 Jul 11 16:11:02.780460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1240/2553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:02.788681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.789146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.790026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:02.790649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:02.870461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:02.884705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:02.886411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:02.887564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7e1b7693-06d4-4765-9994-3dff22fa582e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113563 Jul 11 16:11:02.888153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1314/2554] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:03.792471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:03.793502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:03.802083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:03.803090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:03.804473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:03.805225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:03.806501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:03.807177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:03.813712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:03.814531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:03.815258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:03.815720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:04.016361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:04.019873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:04.024657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3378c548-bf21-4403-8f00-250700893090 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.238732 Jul 11 16:11:04.025237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1241/2555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:04.028502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fe88fd81-3f5d-475a-94e1-ef6abf93ed78 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233245 Jul 11 16:11:04.037946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1315/2556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:04.038111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:04.038111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:04.038111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:04.038111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:04.038438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:04.038438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:04.101331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:04.109926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:04.111460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:04.112619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5bfe50ac-2b21-4ca9-b0ac-ed2d64679a71 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086457 Jul 11 16:11:04.113199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1242/2557] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:05.046313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:05.047403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:05.049026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:05.050136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:05.054696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.055132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.055883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.056104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.056268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.056574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.057328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.057755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.075919 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:05.254856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:05.257831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:05.263134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ea66186-9d98-4b6a-b614-1a3df03ec7c8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223725 Jul 11 16:11:05.263713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1316/2558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:05.265945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e8b8227-50e1-4c59-9977-47651ac6c4b9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223478 Jul 11 16:11:05.266812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1243/2559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:05.268446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:05.269166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:05.275431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.275877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.276662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:05.277095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:05.342416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:05.351380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:05.352922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:05.354067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d15c96af-2e53-4b28-b8fd-a99a4c988a43 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089420 Jul 11 16:11:05.354608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1317/2560] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:06.284664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:06.285271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:06.285801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:06.286423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:06.292349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.292827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.293361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.293562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.293783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.294010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.294557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.294992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.489038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:06.492608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:06.497166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e71c157e-130d-4b44-9fdd-8d7a490b053f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.219432 Jul 11 16:11:06.497748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1244/2561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:06.501057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-be956466-5aa1-46bb-9a48-724244f3916c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220764 Jul 11 16:11:06.501835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1318/2562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:06.502399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:06.503093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:06.509159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.509607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.510329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:06.510757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:06.571929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:06.581296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:06.583131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:06.584308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bbc8a1a1-b882-499c-8e3f-220bad2be396 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.085457 Jul 11 16:11:06.584849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1245/2563] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:07.519393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:07.520235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:07.521886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:07.522891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:07.531119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.531885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.533205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.533626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.534165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.534309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.535024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.535451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.733862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:07.736420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:07.740318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:07.742610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdce153c-9740-4ee7-a5d6-2113e5076ddf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227232 Jul 11 16:11:07.743187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1246/2564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:07.747699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:07.748320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:07.751523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c0c67745-7d0d-4e68-bc62-c35c91a19fff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.239418 Jul 11 16:11:07.752107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1319/2565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:07.755097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.755522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.756472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:07.756910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:07.827205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:07.837036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:07.838550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:07.839699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-26b6b37f-ddc1-4b2b-bffa-3904a0e39a51 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095575 Jul 11 16:11:07.840316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1247/2566] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:08.764368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:08.765251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:08.771633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:08.772259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:08.773885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.774356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:08.775131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.775573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:08.779237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.779688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:08.780493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.780966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:08.975656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:08.978546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:08.983894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e26f919e-b0a1-48f1-bda3-b523a8ca4570 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226529 Jul 11 16:11:08.984478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1320/2567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:08.986631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dffd09c3-19d9-4364-9403-e52624301cb1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220170 Jul 11 16:11:08.987924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1248/2568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:08.989337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:08.989944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:08.996157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.996640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:08.997401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:08.997833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:09.068814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:09.077762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:09.079258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:09.080568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-587362b4-205c-4888-8263-f12338bdcca3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095031 Jul 11 16:11:09.081301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1321/2569] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:10.003660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:10.004319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:10.004689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:10.004893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:10.011262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.011691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.011867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.012147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.012488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.012925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.013090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.013373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.207127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:10.209423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:10.215916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26016a30-b90c-4170-81ba-8bf5fa405b6b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.216376 Jul 11 16:11:10.216532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1322/2570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:10.217843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca6ef593-9e9c-4e03-8bd7-3249bc450efd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219399 Jul 11 16:11:10.218614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1249/2571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:10.221957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:10.222757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:10.228988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.229435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.230219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:10.230656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:10.298533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:10.308172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:10.309726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:10.310866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fdfff574-a634-40f4-a76b-d78f98eb1d1e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093419 Jul 11 16:11:10.311435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1323/2572] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:11.233980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:11.234618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:11.234770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:11.235422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:11.241802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.242282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.242498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.242949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.243063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.243462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.243702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.244137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.439114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:11.441975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:11.447665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-61bf1609-d90f-4f27-a34e-ab750e4e5196 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217519 Jul 11 16:11:11.448176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1250/2573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:11.449907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2683d97e-733f-4d79-8d88-238d17111ebc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.218979 Jul 11 16:11:11.450458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1324/2574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:11.456896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:11.457510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:11.463530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.463964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.464735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:11.465188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:11.526342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:11.535286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:11.536763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:11.537930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5cd4ae63-033d-4f3f-b0af-c89f6dad99b7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088828 Jul 11 16:11:11.538510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1251/2575] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:12.468901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:12.469775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:12.470840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:12.473007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:12.481429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.482178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.483401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.484128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.484412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.485043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.486295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.487017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.688006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:12.695432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:12.696323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ec13132-25bc-44d5-bbfd-5e54b752bde0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.234013 Jul 11 16:11:12.697146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1325/2576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:12.701575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:12.702176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:12.703894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4b472f7-e292-4ed0-b4e7-707c8408dd09 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.239570 Jul 11 16:11:12.704574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1252/2577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:12.708582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.709043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.709802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:12.710242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:12.771147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:12.779704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:12.781258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:12.782404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-809ec60d-08b7-4c48-a658-0112b5284682 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.084479 Jul 11 16:11:12.782971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1326/2578] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:12 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:13.714669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:13.715323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:13.721751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:13.722386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:13.722540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.722977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:13.724004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.724632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:13.729667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.730114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:13.730870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.731303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:13.927569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:13.931765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:13.935898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21b55f09-946f-4198-a8c9-3830d151acf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225164 Jul 11 16:11:13.936507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1253/2579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:13.940201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2011e2bc-522d-461e-9191-b9276cf00468 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222548 Jul 11 16:11:13.940993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1327/2580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:13 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:13.941129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:13.944257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:13.950635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.951139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:13.951925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:13.952392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:14.023603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:14.035949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:14.039311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:14.041262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c8a906bd-84fc-41ee-ac6d-218373170efd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103507 Jul 11 16:11:14.042115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1254/2581] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:14.959058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:14.959918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:14.961220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:14.962267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:14.970400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:14.971168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:14.972590 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:14.973174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:14.973450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:14.974068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:14.974891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:14.975319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:15.166062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:15.172706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:15.174293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2ef1d67b-38f0-4428-94db-dca7c21f9c12 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223062 Jul 11 16:11:15.174854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1328/2582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:15.179308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:15.179908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:15.181053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32dc5706-12d6-45c5-9599-f59ccec0e94d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226645 Jul 11 16:11:15.181792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1255/2583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:15.185917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:15.186676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:15.187504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:15.188144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:15.250997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:15.263026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:15.265430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:15.267189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2654d511-a164-4e90-ad5e-e4b6c4bcb638 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091126 Jul 11 16:11:15.267974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1329/2584] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:15.715409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:11:15.715812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:11:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:11:16.195722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:16.196980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:16.204919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:16.205939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:16.208654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.209513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.210294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.210737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.214289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.214738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.215514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.215956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.409972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:16.415520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:16.420593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d56daed-f8ff-4326-979f-0d8622ff68e0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.231985 Jul 11 16:11:16.421300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1256/2585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:16.423931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2936c9c7-91af-4820-9ba7-04cffcabe322 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226562 Jul 11 16:11:16.428975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1330/2586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:16.429132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:16.429132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:16.432807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.433251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.434003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:16.434428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:16.504625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:16.513214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:16.514677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:16.515855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d5e13552-3f30-4262-939e-b4eee3704e3b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093568 Jul 11 16:11:16.516409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1257/2587] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:17.442177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:17.443459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:17.444728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:17.445246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:17.450624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.451102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.451892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.452279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.452660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.453109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.453890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.454324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.651262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:17.654525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:17.659771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab023442-04e0-440a-b54a-3302d2d336da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224093 Jul 11 16:11:17.660404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1331/2588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:17.665114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:17.665718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:17.667546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-207896f9-82c8-47e3-80e7-d1982a20fd34 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229411 Jul 11 16:11:17.668497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1258/2589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:17.672379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.672838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.673598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:17.674038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:17.740224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:17.753757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:17.756808 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:17.758609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83c78987-c048-4f4b-99ad-1f3c1b51a94d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096904 Jul 11 16:11:17.759372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1332/2590] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:17 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:18.685980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:18.686994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:18.687384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:18.688391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:18.692830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=76 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:18.696322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.696794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.697566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.697998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.698351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.698796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.699547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.699957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.905318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:18.908464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:18.914226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b16b8858-649a-42b1-8dce-0cd106c399af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.234893 Jul 11 16:11:18.914840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1259/2591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:18.916685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-754481e5-871a-42ef-b4cd-33b7e50b9579 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.235512 Jul 11 16:11:18.917459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1333/2592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:18 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:18.920265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:18.920931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:18.927000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.927531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.928282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:18.928737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:18.932720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:18.992469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:19.001035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:19.002566 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:19.003696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9f4c0dcf-e373-410e-8f8a-65f417afc692 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087948 Jul 11 16:11:19.004264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1260/2593] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:19.935354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:19.936475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:19.938177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:19.939185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:19.947419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:19.948168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:19.949468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:19.950194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:19.950425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:19.951085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:19.952377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:19.953120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:20.147341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:20.150744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:20.156237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a2f9be6f-ee60-48ac-9c79-df4de834c876 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224605 Jul 11 16:11:20.156850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1261/2594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:20.166282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-15613951-db77-4089-9822-d93a4ebed658 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.230225 Jul 11 16:11:20.166282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1334/2595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:20.166517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:20.166517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:20.168109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:20.168589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:20.169345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:20.169769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:20.231582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:20.240803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:20.242308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:20.243440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd9413ad-fd82-4178-a0f9-c4ae2081e72e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.085637 Jul 11 16:11:20.243991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1262/2596] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:21.178037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:21.178658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:21.179386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:21.179986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:21.182801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:21.186335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.186829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.187616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.188046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.188201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.188696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.189393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.189813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.644355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:21.647704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:21.653677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fa119a6c-1c7e-4462-91d9-f96702b578ff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.482213 Jul 11 16:11:21.654233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1335/2597] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:21.656508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e9e4fb4-978b-4884-b12b-d7440023d1e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.482391 Jul 11 16:11:21.657261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1263/2598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:21.658961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:21.659581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:21.665934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.666387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.667142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:21.667583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:21.685684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:21.738277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:21.747424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:21.748968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:21.750114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-632726b1-dc81-42b2-a8a3-e2dc879ca204 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094934 Jul 11 16:11:21.750672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1336/2599] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:22.672375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:22.673029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:22.673759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:22.674374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:22.680207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.680686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.681450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.681563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.681896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.682071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.682758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.683192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.886208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:22.889321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:22.894725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bcbac1cf-95ab-4225-87e8-5d3b4abda07f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226307 Jul 11 16:11:22.895307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1264/2600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:22.898270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-98765baf-e436-4603-9cc3-7975cfae6d33 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.228347 Jul 11 16:11:22.898835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1337/2601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:22.900077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:22.900741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:22.907418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.907861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.908654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:22.909078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:22.972039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:22.980999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:22.982524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:22.983667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c0a4cb5-45f5-4250-bced-be1f31a8ec90 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087265 Jul 11 16:11:22.984308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1265/2602] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:22 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:23.915380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:23.916130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:23.917424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:23.918184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:23.925005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:23.925568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:23.926385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:23.926583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:23.926960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:23.927161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:23.928146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:23.928740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:24.125141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:24.127770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:24.133662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-97dec42d-f2f3-4563-9ce4-afe86d7ef32c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221445 Jul 11 16:11:24.134222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1266/2603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:24.136061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9c1c0b4-b737-4287-8cea-f2594c81106d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226153 Jul 11 16:11:24.136803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1338/2604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:23 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:24.138747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:24.139357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:24.145546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:24.146043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:24.146804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:24.147243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:24.215861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:24.228318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:24.230708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:24.232513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05907c4f-3b71-40a1-a86f-01350626d85e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097046 Jul 11 16:11:24.233332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1267/2605] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:25.154858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:25.155798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:25.157833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:25.158843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:25.165133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.165585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.166192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.166308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.166654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.166770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.167419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.167864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.377238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:25.381382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:25.385567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f042c683-c2e8-4b35-9fc3-687485856e39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.237198 Jul 11 16:11:25.386156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1339/2606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:25.389866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4137ffa0-7b2b-4c99-a517-ea51a7ecd3dd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.239537 Jul 11 16:11:25.390712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1268/2607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:25.390848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:25.391448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:25.397690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.398141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.398900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:25.399337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:25.466131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:25.475067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:25.476603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:25.477739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-baa495a4-67f3-43b3-9d38-b23a5dc03ec4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090644 Jul 11 16:11:25.478297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1340/2608] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:26.408499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:26.409412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:26.410493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:26.411499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:26.420763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.421520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.422365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.422742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.423121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.423501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.425437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.426162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.621935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:26.629125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:26.630656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-97a63828-180b-485f-ad21-fc0f683245b8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226740 Jul 11 16:11:26.631402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1341/2609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:26.635919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:26.636549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:26.643739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.644206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.644416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84d6a458-6302-4738-b1e4-1c99912af5d8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.242455 Jul 11 16:11:26.644983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:26.645374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1269/2610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:26.645827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:26.708816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:26.717378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:26.718917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:26.720062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f9bf1dba-0f3c-4f24-8964-c98c929f58a3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087736 Jul 11 16:11:26.720680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1342/2611] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:27.653107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:27.654257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:27.664139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.664424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:27.664979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.665137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:27.665624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.666055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.671814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.672261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.673112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.673540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.866067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:27.869381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:27.874585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84cb7476-c087-4554-84ab-aec8938125b1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.228790 Jul 11 16:11:27.875158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1270/2612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:11:27.877386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2cfaa1f2-dbdc-48e1-aed9-b2531447af2e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.218303 Jul 11 16:11:27.877953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1343/2613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:27.879673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:27.880594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:27.886931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.887508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.888687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:27.889117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:27.954733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:27.964061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:27.965629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:27.966748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43649496-fd1c-41e7-aecf-68a8cf713f54 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090641 Jul 11 16:11:27.967338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1271/2614] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:28.895984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:28.897072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:28.898875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:28.900011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:28.908088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:28.908896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:28.910151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:28.910875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:28.911814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:28.912283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:28.913084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:28.913542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:29.110354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:29.118672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-759801f9-84c1-4bdc-805a-2d97fb222cbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226775 Jul 11 16:11:29.119260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1272/2615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:29.120492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:29.124952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:29.125798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:29.129625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-297a2f13-b738-4a83-84c4-3b9156f8fba3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.240220 Jul 11 16:11:29.130341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1344/2616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:28 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:29.132910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:29.133551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:29.134487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:29.135131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:29.202018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:29.211930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:29.213516 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:29.214689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-04ae4101-c3c9-41e0-8f91-cf898579b447 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093436 Jul 11 16:11:29.215260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1273/2617] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:30.139260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:30.140227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:30.149472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.149917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.150062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:30.150622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:30.150778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.151084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.157544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.157993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.158754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.159189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.342233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:30.347287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:30.351726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-20bcec44-331c-4a52-9e64-be9b96257236 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.219040 Jul 11 16:11:30.352334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1345/2618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:30.356465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84115397-1ec4-44d6-809e-5cb48c9e4482 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.212332 Jul 11 16:11:30.358235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:30.358403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1274/2619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:30.358505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:30.363740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.364203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.365012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:30.365451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:30.432746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:30.445769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:30.447268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:30.448395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-64d75861-a8e5-4bd8-8cdf-886fa84a08a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095130 Jul 11 16:11:30.448953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1346/2620] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:31.373583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:31.374606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:31.377187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:31.378195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:31.384456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.384904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.385656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.386109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.387093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.387527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.388305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.388753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.579303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:31.583315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:31.588877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7c1b5901-059c-4f30-b522-99b0dfb16e5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221894 Jul 11 16:11:31.589692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1275/2621] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:31.591386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aef83669-914e-403a-968d-113ed76becbb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220614 Jul 11 16:11:31.592103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1347/2622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:31.594021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:31.594630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:31.601105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.601561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.602328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:31.602765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:31.665761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:31.669182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:31.674740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:31.676244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:31.677415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a340d423-fde6-4784-8de8-e44dc2a1b8dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087018 Jul 11 16:11:31.677989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1276/2623] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:32.610352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:32.611419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:32.611923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:32.612965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:32.628887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.629746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.630006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.630394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.631296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.631879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.632018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.632670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.827721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:32.830728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:32.837606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a87ff06-e36d-4b08-b82b-55d3777fcaa0 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.233808 Jul 11 16:11:32.838195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1348/2624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:32.839792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5335b563-4fdd-48c9-9b76-4f5c6dc9d335 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.234163 Jul 11 16:11:32.840563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1277/2625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:32.842869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:32.843476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:32.850715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.851571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.852365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:32.852803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:32.927190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:32.937229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:32.938788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:32.939933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-63c817bb-7eb7-496b-b2de-84ccd6f7b364 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100821 Jul 11 16:11:32.940527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1349/2626] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:33.858466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:33.859419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:33.861334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:33.862302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:33.869006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:33.869455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:33.870218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:33.870654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:33.870811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:33.871176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:33.871925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:33.872374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:34.070284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:34.073583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:34.078661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6c5f774e-bed0-4c6e-85bb-5cbdbb1e61e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226907 Jul 11 16:11:34.079280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1278/2627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:34.082434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7389573b-a3ed-43ac-8017-5f02612d1756 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227806 Jul 11 16:11:34.083145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1350/2628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:34.084080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:34.084754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:34.090925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:34.091379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:34.092201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:34.092667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:34.156354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:34.165609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:34.167123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:34.168357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06e629e9-96fd-430c-8bd1-6984f8bf4096 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088152 Jul 11 16:11:34.168916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1279/2629] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:35.101279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:35.102799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:35.103172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:35.104005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:35.112174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.112659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.112849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.113322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.113490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.113863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.114220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.114658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.314920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:35.318798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:35.327495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b421fe43-596f-4ec2-9b2a-61deecebe5a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232343 Jul 11 16:11:35.328253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1351/2630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:35.329983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc25a9df-c0d2-4f50-8f2f-282d65f077a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233334 Jul 11 16:11:35.330522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1280/2631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:35.334060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:35.334663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:35.341074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.341518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.342254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:35.342679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:35.405415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:35.414577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:35.416096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:35.417270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cc013c22-beae-4c30-a10f-ea424035f008 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088068 Jul 11 16:11:35.417858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1352/2632] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:36.350151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:36.351118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:36.352991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:36.353797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:36.359620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.360070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.360665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.360871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.361111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.361298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.361876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.362301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.366304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:36.567148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:36.570002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:36.575915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-741a1aab-a83f-450d-aa67-7507a59552a4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232358 Jul 11 16:11:36.576537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1281/2633] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:36.578217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-609d5ee5-f1f0-4807-b313-e6be433775a5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.231654 Jul 11 16:11:36.579185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1353/2634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:36.581103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:36.582085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:36.588583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.589032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.589800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:36.590235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:36.667246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:36.676667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:36.678204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:36.679360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8195479-c5c1-4bbc-b31d-1013ed7350fe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101922 Jul 11 16:11:36.679924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1282/2635] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:36.849398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:11:36.849745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:11:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:11:37.598084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:37.599183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:37.599825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:37.600014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:37.610257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.610552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.611008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.611269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.612246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.612529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.613012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.613258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.810399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:37.813487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:37.819332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b63f2c75-75ad-4a0e-8f31-6c611236e43e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227824 Jul 11 16:11:37.819906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1354/2636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:37.822053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10f50e95-a5df-4ae0-9f99-c78aa4d0140f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229675 Jul 11 16:11:37.822624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1283/2637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:37.825134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:37.825704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:37.832275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.832757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.833516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:37.833947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:37.896324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:37.905510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:37.907011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:37.908145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b84f0dde-c514-4aba-a09d-016c49b8329c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087299 Jul 11 16:11:37.908740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1355/2638] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:37 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:38.842672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:38.843700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:38.844003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:38.844989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:38.854174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:38.854665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:38.855078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:38.855438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:38.855607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:38.855869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:38.856267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:38.856722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:39.053330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:39.056669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:39.062546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff1d1cb8-c1b2-4952-b41a-a10282225b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227807 Jul 11 16:11:39.063104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1284/2639] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:39.065237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea51d9f0-b402-4928-b93d-e68a3fa57839 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227886 Jul 11 16:11:39.065875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1356/2640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:38 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:39.067760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:39.068355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:39.074873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:39.075320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:39.076074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:39.076538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:39.139132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:39.147647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:39.149176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:39.150476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29ccbb63-82bf-493e-be17-adb24342f10b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086397 Jul 11 16:11:39.151032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1285/2641] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:40.080041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:40.080707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:40.082914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:40.083521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:40.088059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.088525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.089300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.089731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.090265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.090711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.091461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.091886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.285145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:40.292268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:40.293358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96795d94-7e04-4345-a677-b06da4511f9a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.214692 Jul 11 16:11:40.293942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1286/2642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:40.298362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:40.298950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:40.300604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd6b1c43-8c4e-4c29-b1a2-ac49cae65848 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225063 Jul 11 16:11:40.301360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1357/2643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:40.304996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.305481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.306301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:40.306726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:40.378999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:40.392495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:40.394624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:40.396394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-60e0e889-3461-4d38-bef2-7d5024cecdb9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101257 Jul 11 16:11:40.397193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1287/2644] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:41.315260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:41.316404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:41.322667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:41.323724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:41.327685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.328533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.329848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.330531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.335296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.336046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.337542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.338592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.527033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:41.531324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:41.535477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c107bb78-a348-4413-97a2-ed684aa3970d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226738 Jul 11 16:11:41.536046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1358/2645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:41.539370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1001cacf-97f8-4dc5-ae72-29973f9d6831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223781 Jul 11 16:11:41.547713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1288/2646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:41.547908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:41.547908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:41.547908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.547908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.548466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:41.549092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:41.614591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:41.623512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:41.625071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:41.626243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52174688-e6db-479d-91b1-b760220d576d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089211 Jul 11 16:11:41.626806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1359/2647] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:42.557659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:42.558933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:42.559559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:42.560611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:42.569930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.570670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.571377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.572185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.572682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.572799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.572901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.573277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.774195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:42.777192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:42.782844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-80570a50-eb40-4f98-adc8-6b5cf3d8665a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.231967 Jul 11 16:11:42.783390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1289/2648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:42.785377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9055dc8f-a2e6-4989-b265-4d2fcdf5b815 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232305 Jul 11 16:11:42.786259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1360/2649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:42.787850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:42.788437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:42.794781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.795226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.795977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:42.796435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:42.857936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:42.866840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:42.868342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:42.869576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6e6ac8b3-730a-4a4f-9908-41dbc9029462 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.085250 Jul 11 16:11:42.870133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1290/2650] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:43.804418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:43.805474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:43.805832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:43.806912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:43.816772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:43.817511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:43.817814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:43.818383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:43.818709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:43.819462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:43.819693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:43.820338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:44.014157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:44.017897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:44.023411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-285946bf-3ccf-4cc4-a1a6-373de7b7d611 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225517 Jul 11 16:11:44.023958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1361/2651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:44.027250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6876ce76-3109-4bea-9ad1-30ce522dbdb5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227666 Jul 11 16:11:44.027957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1291/2652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:44.028813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:44.029713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:44.038582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:44.039153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:44.040404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:44.041028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:44.102653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:44.111500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:44.113035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:44.114162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-478fe507-992a-4410-922f-7aef75197998 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089242 Jul 11 16:11:44.114727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1362/2653] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:45.052138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:45.053156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:45.053680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:45.054843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:45.061802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.062245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.062999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.063425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.063592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.063920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.064716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.065149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.258576 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:45.262084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:45.267020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ff9d68a1-781c-4c84-a54a-1ef43701102c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221460 Jul 11 16:11:45.267603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1292/2654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:45.270482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f339169b-58f8-4835-97e6-a0f7ee8fb9d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223180 Jul 11 16:11:45.271206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1363/2655] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:45.272464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:45.273062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:45.279172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.279617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.280398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:45.280825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:45.298386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:45.344600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:45.352929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:45.354454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:45.355649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4939af0-3bcd-4505-8a4c-66b74224c667 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087079 Jul 11 16:11:45.356186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1293/2656] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:46.288260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:46.289388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:46.290731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:46.291746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:46.297582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.298005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.298804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.299243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.299685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.300135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.300921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.301344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.493155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:46.496835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:46.501875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17015db8-0046-48e7-98b6-68cc64f57344 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220049 Jul 11 16:11:46.502496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1364/2657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:46.505226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-749ac355-d6c8-4b3f-8f7b-f5082b79c3e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220873 Jul 11 16:11:46.505993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1294/2658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:46.577081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:46.577698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:46.584209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.584686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.585438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:46.585870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:46.655231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:46.664271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:46.665318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:46.666398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42457018-e5f0-4181-8893-1d61d2cfae33 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.163078 Jul 11 16:11:46.666967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1365/2659] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:47.524389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:47.525264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:47.525453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:47.526468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:47.533452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.533893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.534058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.534523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.534691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.535237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.535401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.535699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.738829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:47.742914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:47.747505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ca1d99b4-7572-4a71-9882-1081179105f7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.228289 Jul 11 16:11:47.748266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1366/2660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:47.751847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-07abde90-2a05-4e78-b43f-ffbfc953f287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233972 Jul 11 16:11:47.752480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1295/2661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:47 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:47.755095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:47.755095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:47.761732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.762184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.762949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:47.763388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:47.838695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:47.849968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:47.851485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:47.852672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0fa969b3-3f9b-46df-b7c5-abbc2b95c27c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.103311 Jul 11 16:11:47.853260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1367/2662] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:48.496448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:48.496915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:48.504435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.505228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.506352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.507009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.536112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:11:48.623657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-def3fb83-e9f7-4e47-b229-d3150276f04e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 204 len: 0 microversion: 2.1 time: 0.130624 Jul 11 16:11:48.624343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1296/2663] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:11:48 2022] DELETE /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:11:48.633410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:48.634463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:48.641494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.642176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.643175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.643912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.659243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-969cbcc3-0397-40cf-ab29-ffa4b0ad889e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] Calling method '.version_select at 0x7f20b3277700>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:48.709832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-969cbcc3-0397-40cf-ab29-ffa4b0ad889e tempest-TestVolumeBootPattern-430943135 tempest-TestVolumeBootPattern-430943135-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629573614" status: 202 len: 0 microversion: 2.1 time: 0.056142 Jul 11 16:11:48.710451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1297/2664] 10.222.0.26 () {58 vars in 1262 bytes} [Mon Jul 11 16:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629573614 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 16:11:48.765417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:48.766470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:48.773422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.774061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.774823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.775261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.789929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:48.798113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-def02f6d-634d-4348-93de-054009dfbc5a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169182 Jul 11 16:11:48.798690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1368/2665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:48.803476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:48.804085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:48.806818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=72 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:48.810806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.811491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.814125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:48.814125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:48.991020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:48.998370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:49.001990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:49.006430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f2a4a4c2-cc93-4ebe-b848-c1c85838091e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.245003 Jul 11 16:11:49.007041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c972aef6-8706-4d32-8386-52735a531feb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.207055 Jul 11 16:11:49.007601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1369/2666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:49.012260 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:49.013055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:49.017057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1298/2667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:49.020953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:49.021400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:49.022156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:49.022585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:49.085200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:49.094116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:49.095655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:49.096825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c429119-b1eb-4d93-8bbc-53fb7edf9cef tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088121 Jul 11 16:11:49.097379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1370/2668] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:49.817432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:49.818066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:49.824850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:49.825298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:49.826093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:49.826518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:49.971799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:49.981480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21d3ad0b-25a8-4873-95d5-ea8160b2b70a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167973 Jul 11 16:11:49.982205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1299/2669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:11:50.023707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:50.024349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:50.024654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:50.025283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:50.031152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.031849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.032724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.032975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.033495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.033644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.034387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.034910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.244833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:50.247923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:50.253825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0cdaa37c-f52f-4d57-9472-0cdfa44b42fc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.234015 Jul 11 16:11:50.254636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1371/2670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:50.259480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:50.260259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:50.262150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0301a168-0fee-4842-a570-66988dc5c149 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.241909 Jul 11 16:11:50.265146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1300/2671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:11:50.266888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.267341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.268105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:50.268573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:50.332427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:50.341141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:50.342789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:50.344146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67e21168-0be0-44dd-9eae-29df7f4d75ab tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088380 Jul 11 16:11:50.344748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1372/2672] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:50.581160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:11:50.582011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:11:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:11:50.999810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:51.002335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:51.009225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.009766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.010616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.011155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.140845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.149152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2d5d31a3-cc7b-4922-893c-568d6038ca2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.153529 Jul 11 16:11:51.149730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1301/2673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:50 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:51.271350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:51.271953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:51.279607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.280028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.281010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.281653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.283597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:51.284891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:51.290354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:51.295421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.296512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.297529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.298128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.513968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.520649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.525966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a4c7c027-add3-44ad-88e1-b67d58b236ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.258477 Jul 11 16:11:51.529823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b8b4641-559a-410d-bc36-d81d32ddca42 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.254511 Jul 11 16:11:51.530929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1302/2674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:51.536182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:51.536978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:51.543540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.544269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.544655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1373/2675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:51.545733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:51.546202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:51.616136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.626792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.628338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:51.629562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-213f887c-258b-4d3e-9ed8-cbbda4b979bb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097533 Jul 11 16:11:51.630285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1303/2676] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:52.167607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:52.168134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:52.175785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.176235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.177042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.177469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.364841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:52.373120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-520d6b8b-a539-4ec0-8f4e-33ab8e6ce167 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.209624 Jul 11 16:11:52.374445 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1374/2677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:52.543765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:52.544425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:52.551906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.552392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.553131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.553592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.554380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:52.555101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:52.564396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.565000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.565877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.566410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.931267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:52.937962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:52.946333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dcb7a62b-be1f-4429-8705-16bc91ed8697 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.406557 Jul 11 16:11:52.946752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-727c6e36-6017-46df-accb-e34b774f21e4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.396971 Jul 11 16:11:52.953746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1375/2678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:52 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:52.956026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1304/2679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:52.959678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:52.960388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:52.966608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.967063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:52.967899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:52.968402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.059994 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:53.069166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:53.070728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:53.071883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c4dc74dd-4d59-44a7-a40e-eda0b695f634 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.123657 Jul 11 16:11:53.072479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1376/2680] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:52 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:53.391183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:53.392060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:53.398456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.398907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.399664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.400072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.611173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:53.619575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d2f1111-7c97-4041-b0f8-1897b68ca694 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.232651 Jul 11 16:11:53.620157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1305/2681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:53 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:53.963630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:53.969320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:53.970006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:53.970287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:53.979290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.979736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.980866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.981291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.982690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.983294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:53.984402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:53.984939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:54.285315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.289234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.294209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9bbb60df-c12b-4264-826f-bd295595bec9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.328694 Jul 11 16:11:54.294806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1306/2682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:54.299496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2bc130fd-9124-4510-8836-d890557eba1e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.339849 Jul 11 16:11:54.300500 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1377/2683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:54.301712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:54.302289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:54.313068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:54.313513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:54.314292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:54.314725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:54.386508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.397007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.399515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.400921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8cc9a77d-bb58-48f9-b2ef-9c965e3b5650 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104999 Jul 11 16:11:54.401492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1307/2684] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:54.637261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:54.638190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:54.644986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:54.645648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:54.646611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:54.647050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:54.850318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:54.858887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ee89d41-cc54-4840-904f-aa31ee5bb426 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.225580 Jul 11 16:11:54.859616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1378/2685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:54 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:55.314392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:55.315312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:55.317146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:55.317588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:55.322912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.323471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.324336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.324463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.324888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.325599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.325720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.326068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.783064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:55.794343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0290381-e925-4b3f-925b-239549a45135 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.481188 Jul 11 16:11:55.795237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1379/2686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:55.798293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:55.808918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:55.809554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:55.815129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-199052b7-9620-4a27-9904-7e9156097572 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.501601 Jul 11 16:11:55.816116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1308/2687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:55.824805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.825866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.826545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.827029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.876569 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:55.877192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:55.883397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.883845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.884643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:55.885074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:55.907235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:55.913558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:55.923074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:55.924931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:55.926083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-64af9d86-732e-466e-9f23-9ad9d938b1dd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.121090 Jul 11 16:11:55.926817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1380/2688] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:56.130873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:56.139474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55a55d58-af03-4b94-be17-3540d23a9557 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.266990 Jul 11 16:11:56.139990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1309/2689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:11:56.812458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:56.813234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:56.826143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:56.832450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:56.833173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:56.836371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:56.837477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:56.838272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:56.843603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:56.844052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:56.847896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:56.848417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:57.086517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.090217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.095680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-90b3eb32-782a-4379-a55c-993a36fb5feb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.267394 Jul 11 16:11:57.096967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1310/2690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:57.101865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:57.102536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:57.107862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7f2a7b2d-5a2b-4672-9273-305dae106946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.300068 Jul 11 16:11:57.108498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1381/2691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:57.112540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:57.112540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:57.112540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:57.112540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:57.165902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:57.168109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:57.178005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.186717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.188611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.189780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-82639c71-22aa-4cda-8f6c-07d7c1732eb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091591 Jul 11 16:11:57.190346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1311/2692] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:57 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:57.191926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:57.192415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:57.193375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:57.193813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:57.332883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:57.344273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3aff5b11-0cf4-4ebd-ae45-ab5ea37389a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.191370 Jul 11 16:11:57.344860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1382/2693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:57 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:58.113554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:58.114278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:58.122383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.122917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.123792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.125871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.126626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:58.127332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:58.137713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.138271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.139119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.139614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.345399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.348135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.355136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a160c78f-0b6b-4a63-a807-5536c714de7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.245345 Jul 11 16:11:58.357234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2c02f0e-37da-4d58-acc9-d7cd0c34e48f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.235332 Jul 11 16:11:58.358175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1383/2694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:58 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:58.363348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:58.364207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:58.366166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1312/2695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:58.371091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.371409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:58.371593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.372013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:58.372380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.372821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.378265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.378721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.379474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:58.379900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:58.457066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.466376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.467974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.469179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-212cba9a-ebae-4f52-beba-d6e8899255b9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109649 Jul 11 16:11:58.469759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1384/2696] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:58.532742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:58.541170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-770a0ea4-5908-45a5-8aad-b1e4f2f8da42 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173938 Jul 11 16:11:58.541734 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1313/2697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:58 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:59.377789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:59.378688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:59.379309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:59.379487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:59.390123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.390303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.390541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.390697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.391297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.391442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.391768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.391928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.587241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.592578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.597404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00a20ee5-7bb7-4eaa-98b4-c94b2279ee21 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225449 Jul 11 16:11:59.597966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1314/2698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:59.601275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2d1f9c4f-b813-4866-9d11-8969d504fb18 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.230619 Jul 11 16:11:59.601842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1385/2699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:11:59.602436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:59.603024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:59.608273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:11:59.609094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:11:59.609534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.610000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.610885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.611265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.615551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.616072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.616966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:11:59.617464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:11:59.635166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:59.696482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.705304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.707151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.708282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19289243-b58d-4467-9346-8d7f6107a221 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109408 Jul 11 16:11:59.708861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1315/2700] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:11:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:11:59.771115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:11:59.779234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-75a91db8-c44c-4c6c-8f94-2a6bbecca68e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176046 Jul 11 16:11:59.779811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1386/2701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:11:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:00.614454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:00.615049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:00.618413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:00.619034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:00.622019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.622472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.623244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.623676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.626062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.626518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.627283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.627741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.820017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:00.822809 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:00.828233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4d8e187-b938-4abe-856d-14cb0f7a176f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.217746 Jul 11 16:12:00.828828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1316/2702] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:00.831835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-72a2ea40-be74-4a61-9226-2782572b5669 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217032 Jul 11 16:12:00.832815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1387/2703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:00.834269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:00.834873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:00.841186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.841652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.842398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.842833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.846819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:00.847452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:00.853815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.854261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.855026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:00.855456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:00.914704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:00.923409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:00.924950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:00.926088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-df2a0633-8529-4f42-9a42-7b02096956a9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096318 Jul 11 16:12:00.926647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1317/2704] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:01.003053 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:01.011447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9bb860b6-7407-4329-9ff9-e9db975584c0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168339 Jul 11 16:12:01.012004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1388/2705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:00 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:01.849186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:01.849890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:01.851751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:01.852693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:01.857794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:01.858347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:01.859292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:01.859826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:01.861162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:01.861718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:01.862652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:01.863541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:02.058850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.062274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.067302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55906d80-4212-4130-93e0-d2adc73376b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223946 Jul 11 16:12:02.068034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1318/2706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:02.070757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1eae6792-6389-4751-821f-42320208887a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223907 Jul 11 16:12:02.071530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1389/2707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:02.072284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:02.072901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:02.079401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:02.079883 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:02.080653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:02.081077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:02.084766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:02.085399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:02.091411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:02.091852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:02.092633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:02.093062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:02.170148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.178748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.180256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.181412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7a668443-eff4-48e3-9e2b-9268a7771444 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112605 Jul 11 16:12:02.181942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1319/2708] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:02 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:02.243219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:02.255452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5997add1-73cf-48c5-bf27-d11f31b7d0d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174422 Jul 11 16:12:02.256219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1390/2709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:02 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:03.089361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:03.090363 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:03.091516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:03.092581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:03.099052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.099503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.100265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.100507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.100703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.100953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.101712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.102160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.296957 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.300102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.305451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f2047092-165f-49fa-9774-6d38328d8103 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222633 Jul 11 16:12:03.306088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1320/2710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:03 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:03.308794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9fc7d4df-8354-4047-a1b2-32bfe0a6851c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223633 Jul 11 16:12:03.309678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1391/2711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:03.317507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:03.317507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:03.317814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.318194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.318967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.319404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.323688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:03.324319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:03.330837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.331280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.332425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:03.332852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:03.395307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.404110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.405640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.406772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9929ff1b-dfa4-4431-b4a9-c3ef1ceac23e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.099744 Jul 11 16:12:03.407324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1321/2712] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:03.481953 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:03.490647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a17ae087-de79-49e9-b140-217eb124ae66 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170686 Jul 11 16:12:03.491199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1392/2713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:03 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:04.323741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:04.324364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:04.326711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:04.327366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:04.333949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.334399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.334792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.335191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.335373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.335625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.336018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.336583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.540812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.548510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.552325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-851b7489-8c65-4f0c-843e-a44203618a8f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.229170 Jul 11 16:12:04.553516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1393/2714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:04.561163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:04.562138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:04.562454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b7882fda-da82-4173-b4f9-cd33eca6cc4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.242921 Jul 11 16:12:04.563498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1322/2715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:04.568042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:04.568727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:04.573977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.574419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.574544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.574996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.575360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.575746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:04.575854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.576178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:04.681707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.691760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.693586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.694733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f496a8cd-d46d-4201-b9a5-17dc5b4b7e4b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.140070 Jul 11 16:12:04.707111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1394/2716] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:04.760832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:04.772253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb64b6bc-7ab5-4427-8c34-b25222e49022 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.207783 Jul 11 16:12:04.772864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1323/2717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:05.571081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:05.571708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:05.578710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.579163 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.579923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.580385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.582425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:05.583159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:05.590378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.590825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.591577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.592012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.779679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.782592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.788474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6e59998-f6a3-4d76-9760-d4188a3c3e1b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221310 Jul 11 16:12:05.789161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1395/2718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:05.791033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49d5558c-a197-4d17-819f-25e0979be554 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.213002 Jul 11 16:12:05.791800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1324/2719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:05.793615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:05.794218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:05.800638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.801089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.801843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.802278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.805159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:05.805764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:05.812063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.812542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.813328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:05.813760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:05.873101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.882471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.883982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.885166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-11e8dabc-9e19-4e77-821f-ee06fac07cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095099 Jul 11 16:12:05.886440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1396/2720] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:05.957010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:05.965676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-99592f6a-69e1-412d-ab6b-b8bb03e36e70 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164320 Jul 11 16:12:05.966250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1325/2721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:06.810324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:06.811357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:06.811830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:06.812954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:06.819798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:06.820256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:06.820677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:06.821056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:06.821201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:06.821494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:06.821873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:06.822304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:06.827250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:07.019591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.022211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.028136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0c9c871-4a8b-4b16-b1f6-d87be66f4ea9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224271 Jul 11 16:12:07.028869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1397/2722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:07.030915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-501c9d43-db44-41ed-9d5f-71beab211148 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225463 Jul 11 16:12:07.031674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1326/2723] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:07.033539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:07.034343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:07.041093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:07.041536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:07.041776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:07.042286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:07.042394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:07.042712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:07.048413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:07.048869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:07.049632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:07.050063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:07.116404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.125128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.126620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.127967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a9035aa-288f-4da0-8579-e2e94fb4545b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097899 Jul 11 16:12:07.128827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1398/2724] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:07 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:07.202664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:07.212335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3ab1e2b-8a55-4e3c-96ee-158111b9b6e8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174233 Jul 11 16:12:07.212928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1327/2725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:07 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:08.046249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:08.046841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:08.048145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:08.048801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:08.054030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.054478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.055351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.055784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.056093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.056577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.057328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.057756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.253394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.256777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.261753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-440f411d-591d-42a3-8590-777bfd854bbe tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.219587 Jul 11 16:12:08.262399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1399/2726] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:08.266831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:08.267429 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:08.272483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4ace10fa-9ea6-4509-a7c7-38a95317b5b2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227925 Jul 11 16:12:08.273117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1328/2727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:08 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:08.273482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.273928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.274793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.275229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.277716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:08.278312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:08.284276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.284755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.286228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:08.286672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:08.345673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.354585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.356111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.357262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a9eb8b81-fa6b-483a-98d6-116556d76a0d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093993 Jul 11 16:12:08.358034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1400/2728] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:08.431407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:08.439861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e49fc366-fdcf-4a72-8b44-b092f303145c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165806 Jul 11 16:12:08.440492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1329/2729] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:09.282705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:09.284690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:09.290172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:09.290792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:09.292058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.292549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.293645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.293909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.297260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.297710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.298475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.298913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.489125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.491751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.497721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6d6dcb15-4709-4bdb-a6b2-35d2b237319f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221114 Jul 11 16:12:09.498307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1401/2730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:09.499982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0f7f4cf-cc66-42f6-9eee-c50540ece0a8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.213647 Jul 11 16:12:09.510021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1330/2731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:09.510198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:09.510198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:09.510403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:09.510403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:09.511748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.512197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.512396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.512698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.512988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.513419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.513565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:09.513887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:09.596321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.605261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.606996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.608128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6f6f835a-def6-4887-a687-d462f6ef66c4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.108935 Jul 11 16:12:09.608754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1402/2732] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:09.668572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:09.684486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44d19ea5-0a46-4f74-8214-46409232e7be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.182464 Jul 11 16:12:09.685080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1331/2733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:09 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:10.519033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:10.520247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:10.520587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:10.521229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:10.527337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.527775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.527920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.528282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.528521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.528984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.529147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.529462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.532969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:10.721665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.725020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.729913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1164a155-f05d-4d0d-bb56-4b4f4563ccdd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217505 Jul 11 16:12:10.730461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1403/2734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:10.733443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2dc7fce3-867c-4b4d-b9ac-5f45720da05c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219012 Jul 11 16:12:10.740573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1332/2735] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:10.740744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:10.740744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:10.740940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:10.740940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:10.741789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.742012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.742979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.743410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.745377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.745829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.746584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:10.747010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:10.813056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.822032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.823535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.824721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5a75d780-c2e0-4280-8a3e-19a74ba63380 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093269 Jul 11 16:12:10.825272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1404/2736] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:10.898417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:10.906487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32099a87-189e-4a8d-9f05-da9dbe61d390 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171219 Jul 11 16:12:10.907094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1333/2737] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:11.751932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:11.752893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:11.754125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:11.755161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:11.764938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.765695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.765949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.767194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.767586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.767856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.768945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.769833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.962212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:11.964207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:11.970685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d967faca-7359-419e-aee1-0f3018bb38b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225162 Jul 11 16:12:11.971700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1405/2738] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:11.976585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:11.977263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:11.980174 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b791234e-fc24-42a6-896d-ae2dee423755 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.232411 Jul 11 16:12:11.981050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1334/2739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:11.984571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.985119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.985349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:11.985990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:11.986119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.986513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.992162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.992642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:11.993404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:11.993835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:12.073094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:12.082115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:12.083783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:12.084957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-54e92ca5-d708-40fe-88fe-6cd506832616 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112379 Jul 11 16:12:12.085525 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1406/2740] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:12.142209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:12.154877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32bae436-cc62-4cf5-9c09-2f12c10d7990 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172818 Jul 11 16:12:12.155656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1335/2741] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:12.992825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:12.993693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:13.000774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:13.001753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:13.004406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.004857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.005598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.006064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.009492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.009934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.010718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.011153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.200282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.204552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.209649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1826dc2-0420-4865-a845-47b72230578b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223865 Jul 11 16:12:13.210218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1407/2742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:13.213469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be9eef81-c9eb-40b2-8169-311053a77144 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219298 Jul 11 16:12:13.214227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1336/2743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:13.214683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:13.215287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:13.218726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:13.219388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:13.221537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.222037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.223611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.223996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.225974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.226486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.227372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:13.228236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:13.568707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.577484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.578991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.580137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40ffbe49-c672-4ed6-9872-03eacc1c234d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.368972 Jul 11 16:12:13.580728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1408/2744] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:13.644229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:13.653487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7cbba5b-9dc7-4af3-935f-c0ae8ca13038 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.438309 Jul 11 16:12:13.654065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1337/2745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:14.228168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:14.228931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:14.234980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:14.235622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:14.236084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.236589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.237375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.237817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.242450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.242900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.243647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.244074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.441725 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.443535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.452074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b8710e19-4c15-4753-b784-7bf37c7f9569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227863 Jul 11 16:12:14.452327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab052254-eede-4268-b4cf-bb36a56fe85a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221114 Jul 11 16:12:14.452703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1409/2746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:14.452877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1338/2747] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:14.600249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:14.600987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:14.608607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.609132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.610007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.610511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.671582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:14.672263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:14.679365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.679832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.680677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:14.681111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:14.682934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.692669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.694300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.695587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c2fdaf3-5d11-4113-bb50-99cf533f3394 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100114 Jul 11 16:12:14.696122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1410/2748] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:14.832047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:14.841356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-413bcfb9-f0dd-48da-a420-1d9be7acdfc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173934 Jul 11 16:12:14.841911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1339/2749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:15.473954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:15.474824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:15.475450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:15.475625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:15.484664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.484922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.485338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.485592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.486482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.486726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.487154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.487400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.693550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:15.698150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:15.705446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78eaaf78-affd-4c31-a492-2c7695ad0275 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.237682 Jul 11 16:12:15.706196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1340/2750] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:15.709424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e8316a8-ea67-4057-a195-734b4ba03d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.242126 Jul 11 16:12:15.710166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1411/2751] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:15.717392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:15.717996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:15.724768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.725144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.725890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.726314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.790007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:15.803400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:15.805944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:15.807759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f215a0cf-70ab-4fd9-9cb4-5295589779e9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097736 Jul 11 16:12:15.808706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1341/2752] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:15.861093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:15.861918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:15.870354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.870985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:15.872010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:15.872687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.173370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:16.182616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2d5f3680-94d1-417e-9955-37cd90cdef9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.326864 Jul 11 16:12:16.183198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1412/2753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:15 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:16.726428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:16.727035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:16.728057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:16.728963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:16.734028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.734510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.735280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.735513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.735689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.735961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.736777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.737221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.939243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:16.944097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:16.948961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:16.950800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43b0d7f3-b9c3-466b-8d69-d96bf8710c4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226666 Jul 11 16:12:16.951698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1413/2754] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:16.954780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d8b663f-6eb5-4354-84b5-c6471bfccaff tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233528 Jul 11 16:12:16.955497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1342/2755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:16.956630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:16.957265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:16.963551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.964008 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:16.964805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:16.965244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.026652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:17.035470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:17.037063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:17.038213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d84b8cd-0915-48d5-a72f-9480a7ddbe07 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.085604 Jul 11 16:12:17.038769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1414/2756] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:17.205335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:17.206240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:17.213809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.214262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.215023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.215461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.365007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:17.373714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-291705e0-bdc0-4c6e-b53d-8093293aad72 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175326 Jul 11 16:12:17.374294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1343/2757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:17 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:17.972219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:17.973774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:17.975594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:17.976634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:17.984115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.984914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.986135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.986845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.987023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.987614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:17.989035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:17.989519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:18.182230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.186050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.194888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-383b6ac4-3f0b-4d64-9d4c-5ef5fae7945a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.229246 Jul 11 16:12:18.197234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1415/2758] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:18.197375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5cd8caf-c8df-4f99-a7f3-6a38667e7cb5 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227087 Jul 11 16:12:18.197375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1344/2759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:18.204269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:18.204905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:18.211535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:18.211979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:18.212771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:18.213196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:18.273196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.281746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.283234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.284354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1079e1e-a4b7-4624-a2b0-83896eb67717 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087414 Jul 11 16:12:18.284932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1416/2760] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:18.395362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:18.395975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:18.402452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:18.402897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:18.403655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:18.404084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:18.540215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:18.548234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b8956d0-0427-4b10-8f55-d3426c8bb9a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.159390 Jul 11 16:12:18.548826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1345/2761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:19.212805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:19.213406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:19.214206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:19.214870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:19.215752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=96 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:19.222031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.222269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.222470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.222737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.223273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.223774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.224175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.224624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.417567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.420461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.425685 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4401a693-0564-40d9-83d0-034cce42c273 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.216798 Jul 11 16:12:19.426644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1417/2762] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:19.429070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-25ae8f66-1c6e-4674-8d62-0c7a24a0aa4c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219001 Jul 11 16:12:19.429866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1346/2763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:12:19.431618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:19.432187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:19.444952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.444952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.444952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.444952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.503689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.512724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.514219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.515352 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5da140c5-46f6-42a2-873e-8968847d01e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.087538 Jul 11 16:12:19.515877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1418/2764] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:19.565850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:19.566462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:19.573405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.573855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.574605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:19.575035 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:19.718322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:19.727047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b02ef04-10e7-4a00-afec-5aeac56886a4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165138 Jul 11 16:12:19.727587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1347/2765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:19 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:20.445930 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:20.446553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:20.447767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:20.448532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:20.454456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.454983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.455890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.456783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.456949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.457591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.458598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.459091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.653212 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.657703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.658300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:20.666855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6aca464d-7e56-460d-96c9-3d6fd3b7e983 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225435 Jul 11 16:12:20.667813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1419/2766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:20.669146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0dbae38c-7fdb-401f-9f56-643cf2729cf2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225846 Jul 11 16:12:20.669871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1348/2767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:20.673179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:20.673845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:20.680497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.680945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.681702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.682133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.745109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:20.745847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:20.752449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.752907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.753671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:20.754114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:20.754486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.763520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.765089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.766239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ff3ee1e-b269-474e-8e2a-fc4297eb7e1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097459 Jul 11 16:12:20.766807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1420/2768] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:20.891924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:20.901998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-faf5756b-fbd9-486f-ba23-41d4ee2a91fa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.160830 Jul 11 16:12:20.902603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1349/2769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:21.690512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:21.691449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:21.692098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:21.692282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:21.695211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=96 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:21.702868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.703622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.704116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.704894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.705181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.705644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.706130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.707216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.898874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:21.902142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:21.907401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5aacbb14-b4f6-43ac-833d-2b557b55f628 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223141 Jul 11 16:12:21.908089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1421/2770] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:21.912680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-820fdaca-2aa8-431f-bb35-f4b410b08bfb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.228359 Jul 11 16:12:21.912849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:21.913368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:21.916863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1350/2771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:21.919839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.920321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.921338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.921741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.925217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:21.925932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:21.932198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.932777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.933591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:21.934091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:21.994317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:22.003094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:22.004743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:22.005889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b87fc5b4-dd9e-4710-9bcc-c3ff79f181f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096997 Jul 11 16:12:22.006495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1422/2772] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:22.085323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:22.093376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-928ff71c-a8c3-4a92-b920-d8754eaaa053 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172966 Jul 11 16:12:22.093978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1351/2773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:21 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:22.929047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:22.929047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:22.931632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:22.932245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:22.935970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:22.936451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:22.937221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:22.937653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:22.939125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:22.939582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:22.940383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:22.940815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:23.144925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.149508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.153289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0327a013-9a6d-4ba1-aa95-9f60cb4f7930 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226326 Jul 11 16:12:23.153847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1352/2774] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:23.157883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-898791d0-4551-4d8f-b3bc-cc423f63df13 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.235937 Jul 11 16:12:23.158625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:23.158755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1423/2775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:23.159004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:23.165023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:23.165481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:23.166252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:23.166688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:23.167696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:23.168318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:23.174441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:23.174887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:23.175638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:23.176064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:23.236611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.245704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.247296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.248581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e9778dd-eb78-4075-96f0-8702638f8ab8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093737 Jul 11 16:12:23.249189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1353/2776] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:23.321752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:23.333896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd351d26-295a-4108-b921-37e50e0d2742 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169464 Jul 11 16:12:23.334750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1424/2777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:24.174897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:24.175866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:24.186616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.187323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.188666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.189381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.190427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:24.191411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:24.203434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.203878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.204696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.205132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.397814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.398887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.406245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ca4870b-b12b-4ee1-8216-c69f5797ccae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.237957 Jul 11 16:12:24.406832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1354/2778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:24.411676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:24.412318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:24.417585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37e48066-b695-4984-9ba7-33c2be9fb9ea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.244884 Jul 11 16:12:24.418297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1425/2779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:24.419199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.419635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.420615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.421231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.423372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:24.424046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:24.430991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.431503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.432372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:24.432877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:24.497016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.505676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.507385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.508456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2fb09b46-3d99-4747-a1bf-192314419f46 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100430 Jul 11 16:12:24.508983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1355/2780] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:24.579146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:24.588601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-02a6e94c-6b73-48df-985a-cf1236978722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169079 Jul 11 16:12:24.589179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1426/2781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:25.427502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:25.428334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:25.436909 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:25.437588 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.437749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:25.438147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.439158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.439708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.446118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.446497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.447234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.447689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.634525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.637904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.642923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3a485ab4-810f-47d8-8361-5a0d0806eb43 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221856 Jul 11 16:12:25.643507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1356/2782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:25.646231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7bd2ff47-5996-4231-8318-1af7970faa9d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.214638 Jul 11 16:12:25.646989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1427/2783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:25.651282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:25.651891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:25.657073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:25.657687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:25.657902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.658359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.659157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.659593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.664023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.664501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.665263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:25.665691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:25.748324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.757298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.758808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.760016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-88158d73-b464-433a-a8c2-4397da04f0e4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.115491 Jul 11 16:12:25.760855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1357/2784] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:25.822844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:25.833682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-03127f6a-f0c8-4f7e-8fa2-3217989b669d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185625 Jul 11 16:12:25.834446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1428/2785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:25 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:26.664152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:26.664799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:26.665760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:26.666373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:26.672227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.672712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.673479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.673742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.673907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.674196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.674957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.675393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.872856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:26.876227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:26.881110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bd4d3dd2-f193-4a7c-a09b-c61e4f2587f2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220568 Jul 11 16:12:26.881888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1429/2786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:26.885493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2cebf942-d8c0-4567-8e14-ed1300d79069 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227793 Jul 11 16:12:26.886326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1358/2787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:26.886566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:26.887197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:26.891101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:26.891824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:26.893501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.893912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.894767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.895202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.898617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.899166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.900050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:26.900567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:26.919455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:26.989145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:26.998261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:26.999767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:27.000950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f756a27-7950-4a58-bd7a-9228776aaea0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.118167 Jul 11 16:12:27.001507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1430/2788] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:27.057644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:27.070049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e6507fc-293a-4494-a55f-b5728de6a9bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.182482 Jul 11 16:12:27.070819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1359/2789] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:27.906404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:27.907362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:27.912970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:27.914520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:27.917399 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:27.918099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:27.919253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:27.919913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:27.924083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:27.924832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:27.925992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:27.926611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:28.116206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.119621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.124667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42fcbf16-6987-49c3-aed1-d0887b8b9f61 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224256 Jul 11 16:12:28.125411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1431/2790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:28.127987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e029c788-30f9-4ad0-b2cc-ecd99c5b1946 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223934 Jul 11 16:12:28.135466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1360/2791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:28.135663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:28.135663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:28.135857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:28.135857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:28.137738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:28.138261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:28.139115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:28.139587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:28.139751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:28.140046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:28.140842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:28.141283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:28.228797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.237356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.238835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.239974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-afd965e8-eb28-4593-9519-38fd8ba8661f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113646 Jul 11 16:12:28.240657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1432/2792] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:28 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:28.295424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:28.306368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b760cf96-af0c-4fc2-aff4-1d87a952ed23 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176523 Jul 11 16:12:28.307119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1361/2793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:28 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:29.143458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:29.144077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:29.145969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:29.146606 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:29.151154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.151606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.152403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.152835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.153278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.153727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.154480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.154941 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.349359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.352720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.357935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53c29bd0-12fb-4665-be7c-ae5b3f23fabc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.216704 Jul 11 16:12:29.358807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1362/2794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:29.361250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c60d9ce-8580-4cf9-8e09-012fcbc2450f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222113 Jul 11 16:12:29.368341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1433/2795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:29.368534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:29.368534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:29.368753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:29.368753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:29.370147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.370593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.371349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.371810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.373407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.373861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.374622 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:29.375060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:29.444850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.453409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.454896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.456026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bce58d66-2833-4732-b0ef-da9e60a2dac8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096559 Jul 11 16:12:29.456968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1363/2796] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:29.527974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:29.536643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-529abd47-70c5-42e7-b98a-5e7350be9de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173845 Jul 11 16:12:29.537218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1434/2797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:30.379236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:30.380249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:30.382295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:30.382918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:30.389756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.390202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.390452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.390903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.391027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.391348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.391660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.392095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.589351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.593522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.597697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4aa0681e-d8ea-41a3-bcf7-b99c89cf193e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225014 Jul 11 16:12:30.598280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1364/2798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:30.601664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e67bd1b1-6ee1-474d-860a-ead06c0dd36d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225873 Jul 11 16:12:30.602402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1435/2799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:30.606533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:30.607131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:30.608129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:30.608787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:30.613338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.613797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.614539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.614940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.615095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.615391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.616258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:30.616752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:30.633274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:30.705206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.718833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.721142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.722848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a79a0e65-3e6f-4492-999b-b1af96478222 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.123397 Jul 11 16:12:30.723607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1365/2800] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:30.775424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:30.783692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-28314f60-d4c7-4093-be9b-00a37fb55537 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180514 Jul 11 16:12:30.784328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1436/2801] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:31.615725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:31.616332 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:31.618689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:31.619298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:31.623835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.624277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.625073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.625499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.626610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.627058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.627813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.628243 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.824136 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:31.827325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:31.833007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef275274-061e-45e3-9afa-39c76bb45514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221383 Jul 11 16:12:31.833616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1366/2802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:31.835981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-af2ce3e9-e978-4d96-b975-6148afbf0086 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221275 Jul 11 16:12:31.836785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1437/2803] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:31.838609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:31.844495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:31.844695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:31.844695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:31.845263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.845697 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.846492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.846907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.847679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.848137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.848928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:31.849365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:31.915717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:31.924714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:31.926222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:31.927364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7749d74b-d51a-48e5-81ce-09c225efd7d5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092863 Jul 11 16:12:31.927921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1367/2804] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:32.003754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:32.012274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9cf8bf86-a836-43c7-ba70-2e16483aca7c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174746 Jul 11 16:12:32.012870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1438/2805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:31 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:32.854562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:32.856273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:32.859305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:32.860490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:32.867345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:32.867812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:32.868612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:32.869045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:32.869670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:32.870131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:32.870882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:32.871320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:33.059927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.063758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.068059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-865a6688-58e1-405d-a679-7431a323088d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220292 Jul 11 16:12:33.068648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1368/2806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:33.072314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-005eee98-a820-4c97-82c9-1293ea6f8085 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.219943 Jul 11 16:12:33.073057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1439/2807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:33.073283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:33.073872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:33.080090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:33.080587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:33.081750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:33.082078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:33.085183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:33.085839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:33.091834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:33.092280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:33.093054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:33.093484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:33.169647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.178412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.180423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.181565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ffc15428-79d8-4f64-84aa-4c699268ad14 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112038 Jul 11 16:12:33.182341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1369/2808] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:33 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:33.239114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:33.250270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37106686-b058-4b8b-8752-dcfbc2805299 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168870 Jul 11 16:12:33.250982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1440/2809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:33 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:34.090387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:34.091420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:34.093290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:34.094303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:34.102593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.103038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.103665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.103832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.104117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.104281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.104898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.105331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.297340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.305522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.307322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3c2e7914-9690-44f9-9b4a-f7a4ee6f87e1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224233 Jul 11 16:12:34.307948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1370/2810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:34.312567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:34.313167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:34.313814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-05c9dc21-343c-489d-b68b-258d9c5670a0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227037 Jul 11 16:12:34.314380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1441/2811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:34 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:12:34.318931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:34.319448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.319582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:34.320411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.321347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.321793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.326204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.326684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.327446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:34.327867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:34.395447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.404171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.405693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.406818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-946deb62-3b3c-45d3-9ea4-196b9319a8d9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097915 Jul 11 16:12:34.407341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1371/2812] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:34.483874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:34.494883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8c92032-9bf9-4e75-bc14-16213af93d94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.179421 Jul 11 16:12:34.495457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1442/2813] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:35.329737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:35.330709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:35.335718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:35.336946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:35.343023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.343777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.345083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.345855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.347824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.348654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.349914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.350643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.559278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.566283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.567463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10fcfd47-7d89-4adc-afa3-51e5a5d13332 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.244572 Jul 11 16:12:35.568012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1372/2814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:35.575490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5c911c5a-6aa0-4a68-bb34-119d2b8edf1a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.247273 Jul 11 16:12:35.576865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1443/2815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:35.578025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:35.578642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:35.580584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:35.581607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:35.586067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.586540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.587344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.587774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.587941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.588394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.589238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:35.589769 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:35.676394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.685622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.687152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.688330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6b3b4df8-2945-4be2-8fc3-6f96566352c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.114199 Jul 11 16:12:35.688890 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1373/2816] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:35.747420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:35.759009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a0c6f9c-9d27-4af9-81b3-fe7d1f66e062 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181839 Jul 11 16:12:35.759770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1444/2817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:36.586287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:36.586897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:36.593090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:36.593786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:36.594140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.594594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.595356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.595787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.601036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.601501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.602644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.603257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.794288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.797442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.802562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-852abd74-9589-4868-b2a6-70329c367d14 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222273 Jul 11 16:12:36.803435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1374/2818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:36.806085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ce1be8fb-8be7-4249-acbe-2fb40b931e25 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.217057 Jul 11 16:12:36.806842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1445/2819] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:36.808623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:36.809288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:36.811210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:36.811969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:36.815549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.816073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.816931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.817429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.817863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.818306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.819078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:36.819514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:36.903951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.913963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.915474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.916747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44878936-ab51-46e9-9170-c088da228c93 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112415 Jul 11 16:12:36.917280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1375/2820] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:36.973078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:36.981255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ce8b681d-d2f3-4911-b8a9-085e54cbc5f8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173652 Jul 11 16:12:36.981830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1446/2821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:37.822206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:37.822824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:37.829455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:37.829940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:37.830046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:37.830331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:37.831090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:37.831868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:37.835956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:37.837523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:37.838153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:37.839010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:37.839461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:38.037058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.040319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.045376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a5d7600-dae5-4021-88a8-07803d5d6345 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.228388 Jul 11 16:12:38.045943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1376/2822] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:38.048690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-816def96-8cd4-4c65-a80d-f734ec1f3e60 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223215 Jul 11 16:12:38.049462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1447/2823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:38.050452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:38.051054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:38.057125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:38.057579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:38.058343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:38.058783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:38.060220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:38.061129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:38.069192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:38.069638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:38.070493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:38.070927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:38.148631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.157561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.159109 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.160274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-005363ed-c625-47d3-b5ca-7fbb29aff151 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113387 Jul 11 16:12:38.160878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1377/2824] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:38.222925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:38.231253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f976629b-62ec-4c1d-aff2-a17140e5a5ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174913 Jul 11 16:12:38.231814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1448/2825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:39.065678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:39.066276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:39.068115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:39.068823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:39.074225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.074672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.075424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.075851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.076476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.076933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.077694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.078130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.524203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.527068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.532403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-468cf6c1-6034-4235-a723-b8b790d4d9c1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.472326 Jul 11 16:12:39.532987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1378/2826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:39.535417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ad4b24e9-962b-4faa-a8a3-434e075293e1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.472982 Jul 11 16:12:39.536130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1449/2827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:39.537668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:39.538309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:39.541705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:39.541705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:39.544684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.545278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.546039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.546469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.547253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.547702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.548497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:39.548928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:39.619023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.628091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.629641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.630782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64d34a97-3f9a-4025-8615-f50ab30b97c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096862 Jul 11 16:12:39.631380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1379/2828] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:39.722877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:39.731192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-42e9e616-fc81-4dbb-aca5-e26207b84c2c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.194206 Jul 11 16:12:39.731770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1450/2829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:40.552889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:40.553897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:40.561346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:40.562362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:40.566011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.566764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.568126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.568905 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.572828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.573279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.574038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.574499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.772705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.775630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.781940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4c84638-1046-4813-956c-24035c423d88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.235599 Jul 11 16:12:40.782691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1380/2830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:40.783950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f15aa8e8-c9ec-4434-bcbf-31df33a093be tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229834 Jul 11 16:12:40.784738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1451/2831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:40.789188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:40.789980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:40.796118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.796510 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:40.796630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.797345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.797779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.797891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:40.804070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.804505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.805781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:40.806251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:40.890312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.899373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.900913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.902022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4644395f-6bcd-42dc-847e-ff0990c14fc6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.118609 Jul 11 16:12:40.902584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1381/2832] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:40.953203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:40.962538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-041943d8-3af7-45e1-8a1e-ff4ed7611b63 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177000 Jul 11 16:12:40.963119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1452/2833] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:41.803788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:41.805016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:41.805225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:41.805861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:41.812152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:41.812643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:41.812815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:41.813175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:41.813394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:41.813831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:41.814036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:41.814491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:41.818511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:42.021365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.025093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.030104 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-648eb4d8-99fe-4591-a0c8-7016eb0f3c90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232791 Jul 11 16:12:42.030904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1382/2834] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:42.036790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:42.037528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:42.043505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ce986eae-c72e-4756-9faa-95d5756c0b24 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.244605 Jul 11 16:12:42.044090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1453/2835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:42.044424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:42.044886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:42.045607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:42.046047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:42.048782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:42.049388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:42.055439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:42.055827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:42.056621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:42.057041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:42.119198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.127824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.129367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.130503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c66e8bba-3c65-4030-9c2d-b7c6248ac17e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098907 Jul 11 16:12:42.131944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1383/2836] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:42 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:42.207249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:42.219226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-582514b6-7950-4d41-8db0-848ea22f7dc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173889 Jul 11 16:12:42.219914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1454/2837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:42 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:43.053949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:43.054717 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:43.063550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:43.064269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:43.064902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.065522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.066654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.067310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.073880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.074324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.075218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.075656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.269524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.272591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.278262 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4ec075dd-577c-46ed-b4d7-262028f03101 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220500 Jul 11 16:12:43.278951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1455/2838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:43 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:12:43.281341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39ee65ae-6afb-4d47-9edc-d5af98950ea6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.233758 Jul 11 16:12:43.283455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:43.284062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:43.290567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.290858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1384/2839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:43.291024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.291765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.292199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.295627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:43.296460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:43.303290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.303744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.304662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:43.305080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:43.383466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.392309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.393825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.394995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9ae02514-7e1f-45b8-aed4-27c1809bd1c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.115231 Jul 11 16:12:43.395542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1456/2840] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:43.452173 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:43.461160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c03792f-cc6d-4917-92f9-b76fc00a3ca6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169169 Jul 11 16:12:43.461752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1385/2841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:44.297856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:44.298640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:44.299390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:44.300155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:44.307090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.307660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.308655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.308836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.309200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.310119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.311252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.311802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.508474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.512659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.516707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b99ee7f1-ae07-4784-a011-b4c7f39828b4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223773 Jul 11 16:12:44.517293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1457/2842] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:44.520953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3827ce96-70c0-49f5-8dc2-f1f3214f5dcb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226355 Jul 11 16:12:44.521754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1386/2843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:44.521884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:44.522302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:44.528373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.528828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.529587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.530023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.534437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:44.535236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:44.542764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.543208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.543966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:44.544424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:44.595231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.604216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.605746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.606900 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a378840-fe1e-4897-a2b6-298fbeab07c1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.088666 Jul 11 16:12:44.607466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1458/2844] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:44.693544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:44.701830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-433dc361-4946-4638-bb7f-59ee5baac703 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171077 Jul 11 16:12:44.702402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1387/2845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:44 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:45.539658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:45.540874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:45.541415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:45.542423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:45.551938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.552761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.553076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.553856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.554098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.554838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.555296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.555726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.754316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.758696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.762864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2277a446-7961-42bc-90eb-2d77c693dbab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.228386 Jul 11 16:12:45.763452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1388/2846] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:45.767090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7e8c3be7-8e8e-410c-a6da-941ee2b5a6d4 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.234532 Jul 11 16:12:45.767641 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1459/2847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:45.768896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:45.769655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:45.772814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:45.773833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:45.777331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.777778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.778626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.779176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.780691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.781135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.782674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:45.783112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:45.853366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.862199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.863696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.864856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc648495-e188-4be3-97c9-d0a40af734a4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.100531 Jul 11 16:12:45.865408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1389/2848] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:45.946579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:45.955063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bf066ea6-7da1-45d4-9cff-9e2747900087 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.186296 Jul 11 16:12:45.955662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1460/2849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:46.784754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:46.785780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:46.788512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:46.789406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:46.794156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:46.794608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:46.795380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:46.795817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:46.796443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:46.796901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:46.797653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:46.798090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:46.995134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:46.998990 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:47.003552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3802fca4-6d04-4da9-aa2b-dfcb088080e5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225649 Jul 11 16:12:47.004135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1390/2850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:47.007853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e34ef11f-6feb-407e-85ab-834c8dd1d6e2 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225868 Jul 11 16:12:47.008455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1461/2851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:12:47.008658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:47.009280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:47.020052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:47.020550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:47.021317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:47.021748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:47.084601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:47.093688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:47.095294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:47.096526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4bfc0bf1-07e3-454a-bdcd-66b1e2a35f18 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.091373 Jul 11 16:12:47.097181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1391/2852] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:47 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:47.297258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:47.298165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:47.307644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:47.308241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:47.309094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:47.309651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:47.457039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:47.465942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26b8be49-6f6a-4bce-9487-5b0af1d64331 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.456525 Jul 11 16:12:47.466499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1462/2853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:47 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:48.025296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:48.026280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:48.031425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:48.032481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:48.036873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.037617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.038854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.039564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.041612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.042074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.042834 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.043270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.248985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.252493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:48.252933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.257643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-79f66c20-9eb4-40a1-a62d-73e16d00e1ff tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.239006 Jul 11 16:12:48.258223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1392/2854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:48.261247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-07677ecb-62e3-43ec-bd6d-7bd595ffa00a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.236272 Jul 11 16:12:48.261997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1463/2855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:48 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:48.263466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:48.264075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:48.270824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.271274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.272037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.272600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.340314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.353151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.354640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.355772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55b1a948-9bad-4fe0-8f21-8b13f53f6244 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095926 Jul 11 16:12:48.356346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1393/2856] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:48 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:48.484011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:48.484649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:48.491372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.491814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.492608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:48.493361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:48.640564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:48.648887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43fdbaed-8510-4650-9581-2a5b8eb81da9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169037 Jul 11 16:12:48.649687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1464/2857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:49.278132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:49.278944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:49.280455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:49.281402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:49.284216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=96 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:49.287393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.287958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.289333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.289875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.291787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.292377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.293322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.293866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.488411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.493480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.502444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-186da08d-a4af-4e21-8ec2-8f244cee1589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.229739 Jul 11 16:12:49.503322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1394/2858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:49.505019 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-611eb582-7f43-4aaa-badc-c5cab7b72308 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229427 Jul 11 16:12:49.505773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1465/2859] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:49 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:49.507880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:49.508617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:49.514618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.515095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.515842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.516271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.578526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.588328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.589867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.591013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a7a9b2d-feaf-460d-89ec-89fbad9763cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.086777 Jul 11 16:12:49.591584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1395/2860] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:49 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:49.670678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:49.671651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:49.681231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.681936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.683112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:49.683796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:49.829496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:49.839091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7f3071e-bf63-4872-a441-5eb9e26fbeec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174696 Jul 11 16:12:49.839674 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1466/2861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:50.521280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:50.521972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:50.524219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:50.525084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:50.531181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.531792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.532851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.533462 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.534081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.534690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.535703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.536325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.740916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:50.744028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:50.749301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e206f790-fbc8-4a52-a27c-dd9f6fdd232d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.233243 Jul 11 16:12:50.749882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1396/2862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:50.752763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6785fb38-beac-401c-9cb5-122540084779 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233654 Jul 11 16:12:50.753351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1467/2863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:50 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:50.758378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:50.758976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:50.765194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.765656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.766387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.766812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.828990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:50.837685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:50.839227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:50.840361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8034981-27fe-43af-a8b9-81809515dab0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.085878 Jul 11 16:12:50.840962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1397/2864] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:50.856637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:50.857250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:50.863454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.863901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:50.864676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:50.865105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:51.015363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:51.023416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c697cd01-7a9f-4fc8-89de-e280f8f312ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170979 Jul 11 16:12:51.023983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1468/2865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:50 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:51.770529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:51.771490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:51.773704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:51.774707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:51.777234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=96 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:51.784258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:51.785034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:51.785724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:51.786282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:51.786473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:51.787152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:51.787903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:51.788442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:51.985473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:51.988783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:51.988972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:51.994086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-868314c1-6aa3-497c-bc31-5e077bc375d3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226797 Jul 11 16:12:51.994665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1469/2866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:51 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:51.997802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-81866e34-ae87-4eb0-80b9-3e78ffa3b416 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.233809 Jul 11 16:12:51.998666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1398/2867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:51.999234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:51.999799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:52.006442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:52.006883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:52.007658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:52.008084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:52.040618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:52.041337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:52.047961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:52.048508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:52.049333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:52.049909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:52.069071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:52.077913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:52.079434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:52.080608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aab8da24-d2da-4814-9858-b021fe82c7f6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.084984 Jul 11 16:12:52.081578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1470/2868] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:51 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:52.180992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:52.189381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3aa55f05-dfb6-47d4-bdf5-eae86539fb5d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.152493 Jul 11 16:12:52.189987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1399/2869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:53.015246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:53.016130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:53.018857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:53.019859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:53.028152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.028816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.029583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.029825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.029993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.030268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.031056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.031482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.226264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.230720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.236064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ad37096-799c-44ff-886c-80ef8c871eab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223789 Jul 11 16:12:53.236662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1400/2870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:53.240891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17984ca5-3698-45f0-b949-a9613ff3cb23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.231906 Jul 11 16:12:53.241308 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:53.245699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1471/2871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:53 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:53.245863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:53.246173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:53.246818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:53.248157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.248622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.249372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.249773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.253402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.253833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.254596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:53.255027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:53.320593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.330016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.331917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.333072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-48f6cda2-2e2f-4861-9a4e-b81c2f08ab1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095484 Jul 11 16:12:53.333640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1401/2872] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:53 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:53.413820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:53.424035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b8e0ef5c-81f3-405c-840f-15d3ea565a99 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181387 Jul 11 16:12:53.424649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1472/2873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:53 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:54.256081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:54.257088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:54.261056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:54.261978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:54.266009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.266652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.267679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.268221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.270968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.271572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.272632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.273253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.466405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.470394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.474908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56339123-8589-4e38-85b2-a76c0eafb80e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224363 Jul 11 16:12:54.475471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1402/2874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:54.478988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1d0f9f1-fe61-4204-9715-9684634e70e3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223775 Jul 11 16:12:54.479556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1473/2875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:54 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:54.488720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:54.488720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:54.488720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.488720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.489151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.489151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.494142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:54.494761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:54.501148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.501644 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.502409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:54.502845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:54.562910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.571604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.573131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.574309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-718d18f5-89a7-487e-99c7-0563a12279b8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097877 Jul 11 16:12:54.574968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1403/2876] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:54 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:54.652357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:54.660780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ebae59c-1740-4c3f-9ba1-2f0cbe012b94 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170346 Jul 11 16:12:54.661357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1474/2877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:54 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:55.495804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:55.496929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:55.500278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:55.501368 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:55.508021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.508803 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.510055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.510771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.512088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.512848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.513607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.514137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.711073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.714242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.720417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-08d05359-4781-42f7-b310-e97ff0e3d6af tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.231044 Jul 11 16:12:55.721008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1404/2878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:55.725678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:55.726285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:55.728130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7babb9b4-0d57-490b-a8ca-997f69ff2030 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.234026 Jul 11 16:12:55.730850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1475/2879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:55 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:55.732626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.733062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.733815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.734422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.737456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:55.738179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:55.744650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.745100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.745920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:55.746307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:55.814170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.823246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.824877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.826238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0acc3b35-4441-4489-9ff4-7994069b653e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.104226 Jul 11 16:12:55.826789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1405/2880] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:55 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:55.917331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:55.925832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d5fadb4-140b-4599-a34e-e6da715cb3fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.193214 Jul 11 16:12:55.926397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1476/2881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:56.741493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:56.742629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:56.748581 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:56.749202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:56.751367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.751810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.752629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.753058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.755970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.756449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.757238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.757799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.952107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:56.955759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:56.961008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-845b5870-4a0c-40a1-9791-09d1c9c4393a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225957 Jul 11 16:12:56.961642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1406/2882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:56.964881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-96e89fdf-261f-4581-9b89-44e857b93adb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222351 Jul 11 16:12:56.967131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1477/2883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:56 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:56.967282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:56.967282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:56.971126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:56.971766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:56.976418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.976903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.977680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.977969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.978125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.978427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:56.979222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:56.979657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:57.060530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:57.069639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:57.071161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:57.072340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f7d0ce3-8991-49b5-8f04-7f723d286f32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109740 Jul 11 16:12:57.072871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1407/2884] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:56 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:57.131427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:57.142111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6f0f698-dd9d-4bf2-9134-ff1865386107 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175293 Jul 11 16:12:57.142663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1478/2885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:56 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:57.982868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:57.983492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:57.985079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:57.985696 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:57.990499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:57.990936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:57.991716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:57.992150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:57.992656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:57.993107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:57.993859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:57.994310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:58.189030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.189967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.197563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9920e508-09ed-42f8-8fdc-701b6ec403f1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.218012 Jul 11 16:12:58.198039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-79bd2edb-f5e5-4e86-8a56-82795cbe889c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221472 Jul 11 16:12:58.198789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1408/2886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:58.203417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1479/2887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:57 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:58.208477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:58.209076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:58.212839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:58.213450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:58.215391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:58.215904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:58.216697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:58.217123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:58.219725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:58.220175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:58.220960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:58.221383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:58.240158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:58.308421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.318138 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.319672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.320856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-260b1160-5813-4eea-ba54-167f75b9ef2e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.111917 Jul 11 16:12:58.321545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1409/2888] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:58 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:58.379460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:58.390151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4c606af5-2ab3-4614-a9e3-eaedd864b357 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185707 Jul 11 16:12:58.390738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1480/2889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:58 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:59.215558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:59.216138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:59.216591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:59.216750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:59.224257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.224740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.225520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.225873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.226140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.226327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.227092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.227518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.423679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.431951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.432309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aa9ebdc9-7a66-4380-b143-9e36d59c3f6f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220627 Jul 11 16:12:59.441947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1481/2890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:59.441947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:59.441947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:59.442584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f58f20c9-fa54-42d0-94a8-9c11f09769cd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.230888 Jul 11 16:12:59.443361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1410/2891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:59 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:12:59.446822 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.447466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.448419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.448847 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.449240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:12:59.449764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:12:59.456869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.457311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.458071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:12:59.458514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:12:59.519805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.528593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.530108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.531251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e1075ff-b99f-4575-b4b6-814d3a154969 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.097321 Jul 11 16:12:59.531818 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1482/2892] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:12:59 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:12:59.610163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:12:59.618526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b327298a-4e9e-482d-ac54-8a0db0b57655 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173915 Jul 11 16:12:59.619111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1411/2893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:12:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:00.454875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:00.455750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:00.463176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:00.464179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:00.467282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.467736 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.468560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.468999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.471822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.472396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.473156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.473586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.665412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.668529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.673985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d2be7c2-ea05-4f07-874d-9568031cf206 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226749 Jul 11 16:13:00.684444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1483/2894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:00.684678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-15d2305b-27cb-493f-9dc9-140a673dea23 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221235 Jul 11 16:13:00.684678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1412/2895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:00 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:00.684865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:00.684865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:00.685022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:00.685022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:00.689801 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.689971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.690251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.690375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.691011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.691126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:00.691440 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.691558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:00.780940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.789634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.791125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.792541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2ae5ec6-6ef2-4c62-b31d-6158118deb9e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.116841 Jul 11 16:13:00.793331 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1484/2896] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:00 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:00.845490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:00.853816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3fb1b3b2-f831-4f54-8e01-f2de1f9129d6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174853 Jul 11 16:13:00.854395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1413/2897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:00 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:01.696280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:01.697300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:01.698272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:01.699296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:01.706887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.707340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.707503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.707945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.708091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.708588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.708748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.709154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.904870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:01.907888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:01.913194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-178dd516-6059-438f-99e7-4a4eb58ada32 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223526 Jul 11 16:13:01.913746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1485/2898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:01.918173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:01.918794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:01.925032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.925459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.925907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-86e155a4-c118-4427-860e-dd39672aa368 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.234108 Jul 11 16:13:01.926319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.926767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.935688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1414/2899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:01 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:01.940312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:01.940937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:01.945883 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:01.947059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.947378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.948139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:01.948598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:01.992635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:02.001877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:02.003412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:02.004805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-706576ca-f40e-4ef3-a1e3-61cd5f1ffa1b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.090143 Jul 11 16:13:02.005493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1486/2900] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:01 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:02.095921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:02.108271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d08f11b2-c6ad-422c-bd84-7fe83d5bdaec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171565 Jul 11 16:13:02.108751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1415/2901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:01 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:02.934593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:02.935634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:02.946761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:02.947238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:02.948057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:02.948242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:02.948852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:02.949576 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:02.956961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:02.957461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:02.958352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:02.958782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:03.144577 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.147704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.152925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e8289bc-b3e4-4c2b-ac7c-3292baceb896 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224990 Jul 11 16:13:03.153588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1487/2902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:03.156358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f1bed1c-501b-44f3-b6fc-88b4bab8efdd tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.215631 Jul 11 16:13:03.157076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1416/2903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:02 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:13:03.158335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:03.158991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:03.161299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:03.161968 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:03.166052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:03.166567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:03.167382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:03.167886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:03.168245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:03.168814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:03.169636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:03.170254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:03.258450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.267342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.268901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.270056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3db05b5d-0011-4ed8-88ad-94687defc7bd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.115461 Jul 11 16:13:03.270629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1488/2904] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:03 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:03.322829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:03.331702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d05ad751-091a-4bb9-9087-cc8aef0ff574 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173404 Jul 11 16:13:03.332335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1417/2905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:03 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:04.178309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:04.179306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:04.183865 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:04.185257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:04.194653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.195114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.195245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.195563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.195873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.196315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.196536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.196985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.391374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.396555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.403820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e734d7ca-71e1-44dc-9b14-a69245380111 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227121 Jul 11 16:13:04.404956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1418/2906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:04.408677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-820f05f1-3079-4db7-a427-d51ed7cf773f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.236671 Jul 11 16:13:04.409458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1489/2907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:04 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:04.412477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:04.413078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:04.414728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:04.415565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:04.420879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.421335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.422112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.422544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.423546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.424005 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.424878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:04.425339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:04.771889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.781018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.782503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.783636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-41c599b8-b6b1-4a5c-9930-67ee9e7e6610 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.375784 Jul 11 16:13:04.784276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1419/2908] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:04 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:04.835956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:04.844758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a47ebc5-1bbe-40a6-974e-fbeaf24a7af5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.434020 Jul 11 16:13:04.845329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1490/2909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:05.424527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:05.425090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:05.426903 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:05.427520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:05.432141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.432629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.433390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.433821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.434464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.434907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.435737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.436386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.622922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:05.626453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:05.631838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4dea546d-ca98-4a30-98ca-3599bfd50b06 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.211633 Jul 11 16:13:05.632444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1420/2910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:05.634958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-529d8039-7798-49da-b10d-461056a0dc51 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.211885 Jul 11 16:13:05.635530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1491/2911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:05 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:05.806172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:05.807044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:05.815200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.815643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.816435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.816857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.863485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:05.864102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:05.870297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.870753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.871520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:05.871964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:05.884587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:05.893564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:05.895063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:05.896183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-279cae9c-72bd-42f9-9f5d-c835042c4be6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096823 Jul 11 16:13:05.896766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1421/2912] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:05 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:06.019881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:06.028236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b061679-941a-4fbf-94b2-f06d50a8d072 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168748 Jul 11 16:13:06.028860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1492/2913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:06.649426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:06.650243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:06.654536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:06.655158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:06.657043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.657502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.658256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.658685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.662083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.662535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.663317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.663754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.899028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:06.909572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66a877c9-6fd5-4558-a010-eb3df3420d39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.263982 Jul 11 16:13:06.910137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1422/2914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:06.914863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:06.915472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:06.917973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:06.923022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.923468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.924325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:06.924758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:06.928314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ec3a20f7-947c-47ee-a7bf-1f952856524e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.277575 Jul 11 16:13:06.928958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1493/2915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:06 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:06.999176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:07.013192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:07.015748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:07.017529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f891094d-0979-44f5-85ad-62ba830754ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.106187 Jul 11 16:13:07.018372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1423/2916] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:06 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:07.046007 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:07.046766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:07.054037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.054484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:07.055316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.055732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:07.200356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:07.212867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e08ad510-efca-4303-b4c3-6b68c8be3cea tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170526 Jul 11 16:13:07.213618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1494/2917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:07 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:07.935406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:07.935406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:07.941274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.941706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:07.942458 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.942920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:07.946680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:07.949548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:07.955277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.955727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:07.956869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:07.957304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:08.141291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.145111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.149653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-348e9798-e966-4d67-a023-bd23cdd071a6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224972 Jul 11 16:13:08.150255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1424/2918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:08.153418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e9e49043-8197-4639-a94c-759993b728d6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.210732 Jul 11 16:13:08.159023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1495/2919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:07 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:08.159212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:08.159212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:08.161654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:08.162107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:08.162931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:08.163602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:08.228949 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.231195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:08.231815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:08.237687 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.238888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:08.239180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.239355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:08.240101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:08.240276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f0edb8c1-919c-4973-8ee7-152da652597a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.089145 Jul 11 16:13:08.240559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:08.240962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1425/2920] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:08 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:08.377724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:08.385871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-929aae6e-21bb-45c7-8da5-1cdfac75ecc1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158612 Jul 11 16:13:08.386456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1496/2921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:09.168546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:09.169196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:09.170654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:09.171303 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:09.176554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.177002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.177745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.178024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.178199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.178483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.179242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.179675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.182143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:09.382808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.386184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.391381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-df2d1c4a-8053-4550-956c-76e154bbdcab tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226924 Jul 11 16:13:09.392094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1426/2922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:09.396631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:09.397225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:09.399686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d38b6ef-cc9d-4899-8da2-b9269be823d7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.232673 Jul 11 16:13:09.408020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1497/2923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:09 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:09.408211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.408211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.408211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.408519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:09.408623 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.408708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:09.412503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.412949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.413703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:09.414131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:09.478225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.486837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.488396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.489538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd17d472-611f-4bbe-9fc4-57276d029ab4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096633 Jul 11 16:13:09.490107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1427/2924] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:09 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:09.560121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:09.569419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f26db68-6a7e-49b9-8549-df955a4a1041 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168267 Jul 11 16:13:09.570006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1498/2925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:09 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:10.413316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:10.414365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:10.421253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:10.421921 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:10.423427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.423872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.424649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.425060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.428729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.429182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.430028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.430468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.633317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.636365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.641991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-67900524-6984-4422-8baf-aedd7bbf762f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.235681 Jul 11 16:13:10.642656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1428/2926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:10.645533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1815b40-1cef-4402-b647-e5c341277383 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.230910 Jul 11 16:13:10.651718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1499/2927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:10 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:10.651895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:10.651895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:10.652075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:10.652075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:10.653600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.654046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.655074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.655513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.657342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.657792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.658539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:10.658968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:10.725534 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.734470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.736068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.737225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-210b8c4e-aaa7-45d5-a9dd-4269a54f00cf tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093696 Jul 11 16:13:10.746567 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1429/2928] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:10 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:10.817879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:10.831951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6017a379-d9be-4f12-8ef7-2eaf511a56c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.184185 Jul 11 16:13:10.833051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1500/2929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:11.660333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:11.661069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:11.663534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:11.664258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:11.669497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.670032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.671410 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.671970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.672659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.673232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.674224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.674782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.868619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:11.872231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:11.877636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66e87667-2e76-4a0e-beb6-2388d4863621 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222073 Jul 11 16:13:11.878250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1430/2930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:11.880411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7af2ef74-215f-427c-9aac-8b25021ae287 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221423 Jul 11 16:13:11.880940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1501/2931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:11 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:11.882931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:11.883547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:11.885865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:11.886647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:11.889726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.890180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.890944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.891375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.893423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.893874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.894633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:11.895065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:11.981383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:11.990975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:11.992487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:11.993622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55833319-d76e-45b0-b8fb-d2acfd513691 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.114474 Jul 11 16:13:11.994195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1431/2932] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:11 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:12.050592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:12.059238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f4d36d7a-d9a3-485b-91df-1c51b13a2733 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177137 Jul 11 16:13:12.059798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1502/2933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:12.898963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:12.899935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:12.902913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:12.904177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:12.910953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:12.911710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:12.913026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:12.913751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:12.915113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:12.915917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:12.917274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:12.917998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:12.923680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:13.112796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.116746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.121115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f729f147-7686-48af-89c6-ad6cb75c105e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.228595 Jul 11 16:13:13.121676 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1432/2934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:13.125598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5605aef5-b112-4388-bb54-28b17a5f9243 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229221 Jul 11 16:13:13.126178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1503/2935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:12 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:13.133383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:13.133383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:13.133383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:13.133383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:13.134020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:13.134453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:13.138734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:13.139344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:13.145441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:13.145889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:13.146637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:13.147073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:13.209418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.212574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.214241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.215361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6462b132-d94d-40c5-a564-85fa9b9454ad tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092769 Jul 11 16:13:13.216019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1433/2936] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:13 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:13.306491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:13.315142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6288313c-47b0-4f28-be69-149fdc8586f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180291 Jul 11 16:13:13.315715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1504/2937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:14.142334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:14.143005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:14.144513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:14.145187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:14.151132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.151649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.152544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.152703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.153028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.153189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.153861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.154338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.360478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.363651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.369117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e35edd83-305c-416a-8176-770218458cfd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232704 Jul 11 16:13:14.369692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1434/2938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:14.373585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2454b5ea-c621-4de7-b88b-d45b525626c7 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.233706 Jul 11 16:13:14.374172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1505/2939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:14 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:14.378139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:14.378746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:14.379889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:14.380541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:14.385499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.385944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.386555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.386716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.387004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.387159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.387757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:14.388214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:14.473045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.482059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.483597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.484782 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53bcc349-3fd4-47e0-8a79-c3766e993501 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.110694 Jul 11 16:13:14.485383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1435/2940] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:14 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:14.542727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:14.550882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b45a2be8-39fd-42c2-814f-93bcc5539070 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175405 Jul 11 16:13:14.551451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1506/2941] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:15.388663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:15.389397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:15.392718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:15.394347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:15.399833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.400383 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.401415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.401962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.402670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.403246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.404226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.404821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.597751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.601734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.606168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ffe95a7d-e50d-47ad-86c3-304a9bfd618e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222578 Jul 11 16:13:15.606740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1436/2942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:15.610291 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a09513e-63fa-449a-be48-06c0dab00bac tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223075 Jul 11 16:13:15.610843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1507/2943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:15 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:15.611230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:15.611837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:15.616236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:15.616905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:15.617972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.618430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.619193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.619627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.622726 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.623165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.623907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:15.624407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:15.689061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.698200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.699747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.700942 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c2e6764f-a8e0-447e-9d83-e8adf4c4d230 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.093291 Jul 11 16:13:15.701619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1437/2944] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:15 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:15.777187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:15.785740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9a76a3ff-f4cb-495f-9855-1f03297fc71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173490 Jul 11 16:13:15.786324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1508/2945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:15 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:16.627386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:16.628358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:16.631010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:16.632051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:16.639483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.640213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.641272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.641699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.642455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.642932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.643687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.644117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.838322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:16.842700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:16.848119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-90e92d3b-46d8-4f74-8aaa-98492d9e6eb6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.227221 Jul 11 16:13:16.848727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1438/2946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:16.851336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ea2167d2-4fcd-4b38-bea4-2115f9a276bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227043 Jul 11 16:13:16.851899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1509/2947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:16 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:16.853659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:16.854252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:16.857077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:16.857854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:16.860539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.861203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.862131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.862558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.864744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.865575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.866357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:16.866943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:16.947453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:16.956575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:16.958118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:16.959256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-72b82772-83f9-4d61-be1b-bdba8eee2ca9 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109303 Jul 11 16:13:16.959854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1439/2948] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:16 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:17.016279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:17.028087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6921697a-191a-4b39-a67b-603b77d58ff1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174658 Jul 11 16:13:17.028912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1510/2949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:16 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:17.329813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:13:17.330111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:13:17.868206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:17.869129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:17.870573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:17.871383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:17.877442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:17.878010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:17.879044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:17.879622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:17.880201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:17.880885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:17.881892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:17.882440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:18.079431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.082703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.087886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d9d4ac3-2680-4da2-a603-2329f48615df tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225059 Jul 11 16:13:18.088538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1440/2950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:18.091235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-14adc153-a1d0-46b7-b88e-37d6f55fa9eb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.226054 Jul 11 16:13:18.097584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1511/2951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:17 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:18.097786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:18.097786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:18.098653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:18.098653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:18.099995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:18.100502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:18.101258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:18.101682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:18.104321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:18.104802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:18.105550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:18.105988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:18.170455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.179668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.181196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.182322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-afdec988-53dd-4592-aebc-624fde370978 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.092942 Jul 11 16:13:18.186863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1441/2952] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:18 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:18.260939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:18.273762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-27e62610-fcec-4653-88b7-5acb75574daf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180363 Jul 11 16:13:18.274443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1512/2953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:19.105050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:19.105640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:19.107546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:19.108167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:19.112651 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.113097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.113838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.114283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.115296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.115753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.116570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.117003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.310205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.312996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.313914 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:19.319456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47e047a1-f308-4578-860f-10b2979d46bb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.218266 Jul 11 16:13:19.329456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1442/2954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:19.329653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e39b8e7-a72e-44f7-a68f-2d80d1978342 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.217977 Jul 11 16:13:19.329653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1513/2955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:19 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:19.329866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:19.329866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:19.330044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:19.330044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:19.330044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=98 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:19.332074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.332598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.333479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.333915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.336548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.336992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.337758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:19.338187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:19.481176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.490237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31f759fd-3517-4435-939f-7bad6399044d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166938 Jul 11 16:13:19.490859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1514/2956] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:19 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:19.560766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.569320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.570825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:19.571964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5017937e-8355-4f17-a60f-14fb66877cd8 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.250969 Jul 11 16:13:19.572558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1443/2957] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:19 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:20.341526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:20.342601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:20.343269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:20.343432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:20.354394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.354741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.355167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.355398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.356381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.356633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.357120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.357401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.553805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.559810 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.564882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cd92b833-3f6a-41a3-a1d0-b41682c776d9 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229066 Jul 11 16:13:20.565424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1444/2958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:20 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:20.569700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0a44890d-c260-417c-bc63-fdb663c8f569 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.234714 Jul 11 16:13:20.569991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:20.570491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1515/2959] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:20.570625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:20.576500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.576951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.577701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.578131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.590942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:20.591606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:20.597945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.598387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.599135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:20.599563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:20.682066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.691135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.692717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.693853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d9647bb9-019c-4117-a0d5-e16fb8325aa4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.106932 Jul 11 16:13:20.694411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1516/2960] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:20 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:13:20.738613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:20.746690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58dfe73f-6b7a-4fc2-82bf-30b40742fc5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180336 Jul 11 16:13:20.747285 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1445/2961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:21.583655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:21.584372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:21.589558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:21.590178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:21.591270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.591717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.592509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.592946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.597012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.597464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.598229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.598675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.795351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.798112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.804140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5acc41e-01df-4181-9732-36e72980fcbf tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224780 Jul 11 16:13:21.804850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1517/2962] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:21 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:21.806371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-095a0db1-d075-4a08-8b3e-0edced70f4d6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220636 Jul 11 16:13:21.807087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1446/2963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:21.812970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:21.812970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:21.813252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:21.813252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:21.817288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.817504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=98 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:21.817714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.818486 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.818982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.819511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.819954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.820742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:21.821170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:21.905804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.914746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.916283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.917413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-487ceaf3-c975-4780-afc4-d5f0f70260e6 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.111680 Jul 11 16:13:21.918214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1518/2964] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:21 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:21.976929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:21.986870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d2652bfa-aee0-462b-b286-a7d6c62fa1d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178997 Jul 11 16:13:21.987403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1447/2965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:21 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:22.823033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:22.823732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:22.824120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:22.824239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:22.830481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:22.830922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:22.831537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:22.831981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:22.832149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:22.832488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:22.832774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:22.833209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:23.030985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.034860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.038414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:23.039807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a0f4162-7ffe-4a45-8177-ef17a3cbb03a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220510 Jul 11 16:13:23.040443 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1448/2966] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:23.044620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d41b23d5-0f5e-4332-8923-c99192a09a7a tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225487 Jul 11 16:13:23.045031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:23.045496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1519/2967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:22 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:23.050473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:23.050902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:23.051106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:23.057190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:23.057413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:23.057643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:23.057869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:23.058412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:23.058627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:23.058848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:23.059066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:23.147828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.158267 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.160283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.161505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7075b625-b552-44c3-90d6-5767693c66d4 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.120098 Jul 11 16:13:23.162064 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1449/2968] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:23 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:23.224499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:23.232684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49ff3f48-304c-4e0b-acfc-79218dcaf997 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.186339 Jul 11 16:13:23.233272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1520/2969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:24.062206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:24.063164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:24.065653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:24.066660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:24.074242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.074989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.076343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.077032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.077496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.078430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.079837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.080310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.284628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.287616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.292835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-78934239-ef2f-4654-b481-e4b0575f5d94 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.237572 Jul 11 16:13:24.293376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1450/2970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:24.296065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fbabf908-25de-4295-ae6e-ea542587af49 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.237062 Jul 11 16:13:24.298538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:24.299220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:24.300888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1521/2971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:24 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:24.305639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:24.306828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:24.308228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.308703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.309799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.310125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.312504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.312978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.314412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:24.314947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:24.398872 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.413135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.414628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.415776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-54ed9665-6d88-4f7d-9f8c-a9b5387d41b3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.121469 Jul 11 16:13:24.416679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1451/2972] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:24 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:24.476216 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:24.484297 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c475bf6e-ca8c-4838-bbb4-5a28ef2b5a1e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.182469 Jul 11 16:13:24.484927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1522/2973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:25.314478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:25.315515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:25.316598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:25.317596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:25.326401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.327143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.328441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.328676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.329312 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.329484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.330113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.330615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.521474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.528127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.532926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-38f87fdf-07be-42d6-b17f-726ac19ca46b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224724 Jul 11 16:13:25.533517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1452/2974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:25.538042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:25.538659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:25.539750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-951485cf-f1a5-48fc-95da-7b1d444fb044 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.229597 Jul 11 16:13:25.544780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1523/2975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:25 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:25.545659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:25.546261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:25.548641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.549034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.549835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.550248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.552528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.552972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.553715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:25.554126 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:25.635906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.645387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.646934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.648069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b454f8d7-cc15-4b78-b689-0af26162f2eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.113631 Jul 11 16:13:25.648870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1453/2976] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:25 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:25.703640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:25.712866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-40e1a0a2-ab25-4c01-b7c4-6a1601689634 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170600 Jul 11 16:13:25.713456 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1524/2977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:25 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:26.552897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:26.552897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:26.557844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.558284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.558850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:26.559314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.559423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.559537 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:26.567860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.568320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.569104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.569889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.750528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.759096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc428c13-3675-4e24-a604-3998111a6cbb tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.212696 Jul 11 16:13:26.765243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1454/2978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:26.765243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:26.765243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:26.768613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.771507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.771953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.772764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.773150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.776897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-008f8e9d-4b08-47f8-993e-eb05b9e4c1fb tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222246 Jul 11 16:13:26.777460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1525/2979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:26 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:26.781858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:26.782488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:26.788517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.788933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.789718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:26.790155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:26.847211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.859490 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.861522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.862667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-883aaa22-43a6-416c-9c09-d894a7dff511 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.102051 Jul 11 16:13:26.863225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1455/2980] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:26 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:26.947637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:26.956613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d5e30e2-652d-4731-b65d-e7e3b7d1b141 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177847 Jul 11 16:13:26.957196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1526/2981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:27.779770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:27.780411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:27.789611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:27.790053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:27.790780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:27.791242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:27.794733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:27.795383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:27.802309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:27.802765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:27.803541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:27.803978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:27.989622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:27.996938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:27.998012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a3a6ecd1-21df-4d22-b76c-c20a0fee8a70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224581 Jul 11 16:13:28.007489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1456/2982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:28.007489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:28.007489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:28.007890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fef1a266-bc66-4f96-9047-f99a1babef4b tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.214819 Jul 11 16:13:28.007890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1527/2983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:27 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:28.010103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:28.010555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:28.011318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:28.011757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:28.018700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:28.019300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:28.025226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:28.025670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:28.026419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:28.026846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:28.084328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:28.093182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:28.094720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:28.096048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ee07ffc0-be81-4c5d-aa74-1a0e72888215 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096401 Jul 11 16:13:28.096845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1457/2984] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:27 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:28.173382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:28.187379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a8a5ff46-b0eb-47a2-9002-52e45251c0d2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172054 Jul 11 16:13:28.188371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1528/2985] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:28 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:29.015290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:29.015855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:29.022760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:29.023309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.023309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.023528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:29.023997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.024432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.030390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.030856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.031596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.032119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.219419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.223225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.228896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4b2b8e7-6d3c-4c29-953a-06bc8e8871da tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217623 Jul 11 16:13:29.229481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1458/2986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:29.233464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-24be9f76-f59a-4997-bb22-f95fd9aca901 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.212866 Jul 11 16:13:29.234328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:29.234951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:29.239511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1529/2987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:29 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:29.241895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.242356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.243132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.243551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.244882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:29.245562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:29.251813 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.252380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.253217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:29.253734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:29.262665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:29.317718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.326326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.327855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.329205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-230e70a5-97d5-4a97-8e04-d95aef74c2fd tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098623 Jul 11 16:13:29.330268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1459/2988] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:29 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:29.409021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:29.417000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf93f06d-7f85-45ce-8449-8e8e35266142 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176156 Jul 11 16:13:29.417570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1530/2989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:30.246499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:30.247089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:30.249098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:30.249719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:30.254537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.255017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.255783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.256215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.256886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.257346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.258110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.258563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.454563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.458164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.463261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-814ab9a8-c859-4bf6-89b8-a222df163f42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220701 Jul 11 16:13:30.464060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1460/2990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:30.466867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0b0d24fe-507e-4a0a-8443-127f274e1c7c tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.221648 Jul 11 16:13:30.467596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1531/2991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:30 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:30.468851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:30.469499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:30.475710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:30.476369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:30.476503 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.476861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.477626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.478092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.482451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.482901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.483657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:30.484090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:30.562898 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.571731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.573276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.574423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-492bc5c2-a588-4e0c-a49c-f2f8b41f9f6e tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109434 Jul 11 16:13:30.574951 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1461/2992] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:30 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:30.635658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:30.643849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b35865b7-7050-401b-af47-79d96ad895da tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175327 Jul 11 16:13:30.644454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1532/2993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:31.485753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:31.487296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:31.488609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:31.489200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:31.494282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.494729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.495509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.495939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.496067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.496446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.497202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.497638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.694826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.698023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.702931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62b612ff-2d11-467e-8ae8-b6b30629a98e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224441 Jul 11 16:13:31.703557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1462/2994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:31.706785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c78ba342-1a13-4fd6-acd5-f6c7ac03ec8d tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223706 Jul 11 16:13:31.707651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1533/2995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:31 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:31.708948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:31.709616 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:31.712089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:31.712784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:31.715953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.716511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.717343 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.717869 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.719192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.719717 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.720689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:31.721323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:31.794581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.803465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.804985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.806110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c33a7235-4fb7-4017-b94d-b7a271550afe tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.101551 Jul 11 16:13:31.806685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1463/2996] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:31 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:31.889825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:31.901610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6aa17296-0c4b-4497-82dd-f84ec41f9b92 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.192866 Jul 11 16:13:31.902351 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1534/2997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:31 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:32.727589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:32.729080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:32.733754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:32.734764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:32.739685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.740134 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.740978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.741429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.742588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.743052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.743793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.744225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.937454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:32.941467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:32.949168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4aef604d-f7ee-4a28-9956-0621220ef01b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221460 Jul 11 16:13:32.949968 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1535/2998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:32.952736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c0f789f-0b0e-47a1-89e7-3816dedff443 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.231783 Jul 11 16:13:32.959825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1464/2999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:32 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:32.959996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:32.959996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:32.960193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:32.960193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:32.961874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.962675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.963096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.963533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.965887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.966358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.967098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:32.967528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:32.982055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:33.048535 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:33.057746 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:33.059300 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:33.060488 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44bd865c-bd6b-4a0d-b1d4-6ea5b2233b32 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.109538 Jul 11 16:13:33.061084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1536/3000] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:32 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:33.122573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:33.132582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f77d0e4-2c69-4e7d-aaa0-70173ef5283a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178313 Jul 11 16:13:33.133151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1465/3001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:33.971346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:33.972340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:33.972982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:33.973610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:33.979347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:33.979792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:33.980450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:33.980637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:33.980899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:33.981075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:33.981647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:33.982076 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:34.176353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.181936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.187145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3da1ee24-c76a-48b0-9349-485859b1aa82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.222358 Jul 11 16:13:34.188625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1537/3002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:34.192222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-088c4ef2-72fd-4efe-8e7b-ad840376f009 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225041 Jul 11 16:13:34.193145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1466/3003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:33 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:34.197809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:34.198380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:34.202282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:34.202959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:34.204897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:34.205346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:34.206935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:34.207374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:34.210253 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:34.210712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:34.211529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:34.212029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:34.296317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.305651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.307196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.308350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef4e0181-3c53-4160-a5b4-5acd36a2c45a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.119111 Jul 11 16:13:34.308925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1538/3004] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:34 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:34.357974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:34.366964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c45fb060-d808-442e-8bdf-af5ddd677770 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172878 Jul 11 16:13:34.367515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1467/3005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:35.208836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:35.209422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:35.210366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:35.211091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:35.216032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.216558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.217308 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.217737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.217910 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.218379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.219131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.219555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.673260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.677881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.685152 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-797ff592-1751-4a7a-845d-bf063e3cfaae tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.479139 Jul 11 16:13:35.686057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1468/3006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:35 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:35.688951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a687b8e8-76b5-41a4-9fe1-6e09074feb99 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.485734 Jul 11 16:13:35.689782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1539/3007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:35.690827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:35.691500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:35.694835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:35.695417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:35.697908 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.698438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.699278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.699776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.701673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.702115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.702896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:35.703330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:35.769617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.778564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.780098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.781266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-40ca8d70-535a-4468-9ee6-ea39f826eb04 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.094256 Jul 11 16:13:35.781827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1469/3008] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:35 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:35.854369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:35.864618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6ee9cda1-4ea8-4967-bfe7-256f1eb6eaf7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174018 Jul 11 16:13:35.865218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1540/3009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:36.709795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:36.710522 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:36.713404 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:36.714551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:36.718543 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.719086 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.719976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.720529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.722134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.722646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.723549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.724040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.914065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:36.920971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:36.927638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c297d297-378d-43b4-8864-ce53a7633516 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223657 Jul 11 16:13:36.928557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1470/3010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:36.933941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f391d5c-3722-4e30-a3f3-dc7bdd951af0 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225007 Jul 11 16:13:36.935096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1541/3011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:36 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:36.935724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:36.936781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:36.941778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:36.942403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:36.945220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.945631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.946380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.946815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.949257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.949708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:36.951923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:36.951923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:37.032723 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:37.041762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:37.043290 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:37.044478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c791874c-f627-41b1-aee4-62017e98bb2f tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.114646 Jul 11 16:13:37.045273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1471/3012] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:36 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:37.102396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:37.115740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8dd3afc9-528c-4150-9d7d-d514a0d7c0ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.179396 Jul 11 16:13:37.116761 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1542/3013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:37.959977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:37.960638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:37.960962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:37.961711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:37.967658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:37.968110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:37.968545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:37.968912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:37.969064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:37.969345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:37.969730 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:37.970167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:38.169229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.173161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.177859 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e88b0914-04c6-4f33-aa7b-0166d63f60f5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223043 Jul 11 16:13:38.178451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1472/3014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:38.181933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-df52f530-93ba-43f4-a0a5-d8c9083a6fd8 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.225642 Jul 11 16:13:38.187754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1543/3015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:37 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:38.187927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:38.187927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:38.188150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:38.188150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:38.196783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:38.196783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:38.196783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:38.197141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:38.197240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:38.197338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:38.197338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:38.197338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:38.283078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.292128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.293672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.294813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdcd0f61-bdf2-410c-b4cf-8f4576a23759 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.115475 Jul 11 16:13:38.295413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1473/3016] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:38 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:38.352756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:38.360948 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9058838b-eea5-4270-877b-1770ba93f047 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177222 Jul 11 16:13:38.361562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1544/3017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:39.198077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:39.198690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:39.199459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:39.200071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:39.205376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.205819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.206958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.207390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.208852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.209302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.210081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.210517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.404598 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.407407 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.413189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7eff84a1-3aaf-4fbf-86b4-68e5eebec5b6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220349 Jul 11 16:13:39.413814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1474/3018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:39.415777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fdfd098b-f19c-4952-85fa-cd6474475c7e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.220075 Jul 11 16:13:39.416550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1545/3019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:39 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:39.420770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:39.421353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:39.421894 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:39.422034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:39.428477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.428691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.429013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.429182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.429759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.430022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:39.430174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.430455 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:39.517797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.526547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.528034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.529272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-329664e7-853b-46a0-8f61-8ea66bf9683b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.114538 Jul 11 16:13:39.529836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1475/3020] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:39 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:39.589389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:39.602160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-68883852-13a3-4077-9293-5e65b0214f17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.184563 Jul 11 16:13:39.603133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1546/3021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:40.434370 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:40.435361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:40.436786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:40.437830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:40.445880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.446494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.447742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.448497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.448742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.449470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.450729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.451458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.455018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:40.646202 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.649293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.654393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c2607df0-982e-4581-9d8a-5d12956309bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.226472 Jul 11 16:13:40.655061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1476/3022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:40.657842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-57a246ff-c687-494a-ac1c-2509ae79fcf1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.227442 Jul 11 16:13:40.658388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1547/3023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:40 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:40.666123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:40.666123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:40.667476 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:40.667775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.668080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:40.668224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.669063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.669533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.674109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.674560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.675315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:40.675748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:40.743047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.751713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.753245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.754411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e1f5dc9f-50b4-45a8-a345-c31def9904eb tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.098442 Jul 11 16:13:40.755063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1477/3024] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:40 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:40.830943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:40.844143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9f52de25-1042-4db9-96eb-e9edfc7329be tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.179935 Jul 11 16:13:40.844979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1548/3025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:41.673484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:41.674494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:41.676764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:41.678026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:41.682658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.683379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.684165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.684619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.685519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.685972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.686762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.687383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.877780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:41.881467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:41.886176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8920fe45-54c9-406b-9ee3-f05745bcbf70 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217211 Jul 11 16:13:41.886885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1478/3026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:41.889572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3dc75b23-b353-472b-9a49-f06a5be6b945 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.218689 Jul 11 16:13:41.899600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1549/3027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:41 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:41.899804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:41.899804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:41.900014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:41.900014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:41.900220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.900220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.900220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.900220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.904400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.904839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.905595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:41.906011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:41.971530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:41.980822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:41.982318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:41.983456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cdc95e11-3a43-4e67-81c1-6835d09eff47 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.095785 Jul 11 16:13:41.984007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1479/3028] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:41 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:42.064841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:42.073347 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8f29c38a-60c4-4cbe-98d4-7eabb22f6b89 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.182278 Jul 11 16:13:42.073947 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1550/3029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:41 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:42.907741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:42.908761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:42.910588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:42.911888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:42.917473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:42.917930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:42.918684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:42.919113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:42.919374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:42.919580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:42.920370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:42.920798 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:43.116642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.119551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.124806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b5fca1c9-44d3-476f-bb9b-32dc3765e422 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.223614 Jul 11 16:13:43.125353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1480/3030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:43.127574 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fcc683b6-55cf-4bb4-932b-d89a71bb8854 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.223409 Jul 11 16:13:43.129966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:43.130559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:43.131661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1551/3031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:42 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:43.136611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:43.136793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:43.137119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:43.137296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:43.137878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:43.138305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:43.143426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:43.143908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:43.144734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:43.145155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:43.222325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.231034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.232565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.233694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef76bdf1-2179-4996-a96d-bf5a28759a0a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.107411 Jul 11 16:13:43.234253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1481/3032] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:43 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:43.290668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:43.298943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4455af3a-2fbe-4e7d-86ca-cfe7e714f330 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165992 Jul 11 16:13:43.299524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1552/3033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:44.146413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:44.147433 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:44.147570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:44.148227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:44.154485 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.154939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.155088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.155508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.155662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.156114 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.156248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.156694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.160688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:44.353298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.358117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.365479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d5164b1-f5aa-4af8-9714-366792036dc3 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.224081 Jul 11 16:13:44.366232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1553/3034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:44 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:44.370301 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-022be716-3867-4b09-8129-635eb9627985 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.230243 Jul 11 16:13:44.371084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1482/3035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:44.372498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:44.373105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:44.376006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:44.376831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:44.379210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.379661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.380977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.381739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.384065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.384530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.385279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:44.385699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:44.451511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.461091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.462619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.463766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd4f29d1-2a17-4450-ac13-393c17506f24 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.096302 Jul 11 16:13:44.469318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1554/3036] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:44 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:44.540635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:44.549091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-16351df4-58ab-4a45-b0d5-1579bdc4c5c1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176849 Jul 11 16:13:44.549672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1483/3037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:44 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:45.385528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:45.386180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:45.387858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:45.388555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:45.394971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.395468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.396340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.397145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.397329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.397837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.398600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.399030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.602966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.606135 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.611531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-68663488-b0d4-43b5-b8e2-06243c98d29f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.230358 Jul 11 16:13:45.612089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1555/3038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:45 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:45.614324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64a72940-5e01-4498-b8e9-bfef15dac1bd tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.230694 Jul 11 16:13:45.622037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1484/3039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:45.622219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:45.622219 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:45.622416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:45.622416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:45.624266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.624796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.625556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.625969 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.627538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.628052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.628850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:45.629284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:45.724785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.736965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.739164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.740815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a08e85ca-08a8-4be9-a064-b81df5628c3c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.127622 Jul 11 16:13:45.741606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1556/3040] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:45 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:45.797438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:45.809620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1b9cdbb-2a42-44bb-9eef-ecfc08b7c3f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.192976 Jul 11 16:13:45.810403 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1485/3041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:46.632437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:46.633093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 61dce4e3-c747-471a-994d-8f005b95f31e] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:46.633669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:46.634282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:46.640143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.640629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.641079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.641398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.641550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.641814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.642270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.642698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.837228 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:46.839837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:46.846324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-373d6b2f-a506-4d52-924c-81bc8eb79f24 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.217762 Jul 11 16:13:46.846986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1486/3042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:46.848570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-579a3bc1-3662-4f85-8259-10309759c3a1 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e" status: 200 len: 1736 microversion: 2.1 time: 0.222206 Jul 11 16:13:46.857452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1557/3043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:46 2022] GET /compute/v2.1/servers/61dce4e3-c747-471a-994d-8f005b95f31e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:46.857645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:46.857645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:46.857854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:46.857854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:46.859920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.860461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.861169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.861338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.861620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.861878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.862384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:46.862814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:46.948649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:46.957686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:46.959197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:46.960759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa14b721-e1c8-4d4a-95e4-72028dd41206 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 200 len: 1444 microversion: 2.20 time: 0.112724 Jul 11 16:13:46.961353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1487/3044] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:46 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:46.965774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1dd4f239-d1cd-465c-b9d2-52541e9d2dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '.version_select at 0x7f20b3277940>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:46.985727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1dd4f239-d1cd-465c-b9d2-52541e9d2dba tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808459836" status: 202 len: 0 microversion: 2.1 time: 0.023345 Jul 11 16:13:46.986347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1488/3045] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 11 16:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808459836 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:13:46.991386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d7ba2bc3-f48f-4a2b-968d-df687d44d1a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '.version_select at 0x7f20b32fdc10>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:47.012055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d7ba2bc3-f48f-4a2b-968d-df687d44d1a7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-439521934" status: 204 len: 0 microversion: 2.20 time: 0.024684 Jul 11 16:13:47.012866 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1489/3046] 10.222.0.26 () {60 vars in 1258 bytes} [Mon Jul 11 16:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-439521934 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 16:13:47.047595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:47.057270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d95f8ceb-d46d-466d-86ff-ff254f7b3485 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.207061 Jul 11 16:13:47.058073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1558/3047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:46 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:47.864014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:47.866005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:47.876091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:47.876319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:47.877146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:47.877526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:47.942146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49f15288-5b63-441a-9f54-6d32df60edb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'create', calling method: .version_select at 0x7f20b3df5310>, body: {"keypair": {"name": "tempest-keypair-262050551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyxE9FzLZEYc7ZGFPJXoX0Ls032Tfs4SDBC3DOzhOejkRScGQHzjb+05WqiTfWoWyxVZB3xMFiN7dGVxHN21VeAYozSI932PKMeqqI8l+yfTtpIGSli36Akis/C+mOkUg=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:13:47.959080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-49f15288-5b63-441a-9f54-6d32df60edb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:13:47.964540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-49f15288-5b63-441a-9f54-6d32df60edb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for user 046cf5e98eca41c0a532e84f777efaab and project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:13:47.986438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:47.998371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49f15288-5b63-441a-9f54-6d32df60edb2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059899 Jul 11 16:13:47.999411 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1559/3048] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 11 16:13:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 11 16:13:48.051722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:48.063351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-61a7acd7-ff0b-43c5-ab57-d30899aea5c6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.203979 Jul 11 16:13:48.073695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1490/3049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:48.079864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:48.080947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:48.093362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:48.095368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:48.096888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:48.097977 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:48.134801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-89d94485-ed2f-4f68-89db-f04dbc63cda9 req-af5a34fb-c73b-48d0-98d2-69e8b586a393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:13:48.150621 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-89d94485-ed2f-4f68-89db-f04dbc63cda9 req-af5a34fb-c73b-48d0-98d2-69e8b586a393 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:48.151649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-89d94485-ed2f-4f68-89db-f04dbc63cda9 req-af5a34fb-c73b-48d0-98d2-69e8b586a393 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:48.171298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-89d94485-ed2f-4f68-89db-f04dbc63cda9 req-af5a34fb-c73b-48d0-98d2-69e8b586a393 service nova] Creating event network-changed:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 16:13:48.178638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-89d94485-ed2f-4f68-89db-f04dbc63cda9 req-af5a34fb-c73b-48d0-98d2-69e8b586a393 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148381 Jul 11 16:13:48.179469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1560/3050] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:13:48.300665 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:48.309685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7726b801-dbdc-43e8-ac35-13f892efc722 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.237253 Jul 11 16:13:48.312331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1491/3051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:13:49.083604 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:49.085935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:49.094875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:49.095589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:49.096555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:49.097177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:49.294139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:49.302648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c2f33abe-0a03-4ad6-b8a3-2ddd63e4f573 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.225318 Jul 11 16:13:49.312359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1561/3052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:49 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:49.327177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:49.327781 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:49.335509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:49.335959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:49.336809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:49.337249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:49.557069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:49.565499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d677439-818d-4f36-a845-586032f20ca2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.242239 Jul 11 16:13:49.566057 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1492/3053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:49.746264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1806884071", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4796293e-9cfd-499e-8fa0-df1de6a745bf"}], "security_groups": [{"name": "tempest-securitygroup--1157525935"}], "key_name": "tempest-keypair-262050551", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:13:49.857722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] validate_networks() for [('4796293e-9cfd-499e-8fa0-df1de6a745bf', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:13:50.319927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:50.320477 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:50.326834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.327280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.328075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.328542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.344605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:13:50.345121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:13:50.345493 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:13:50.346570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:13:50.347024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:13:50.357471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.357905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.358709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.359143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.376324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:13:50.380571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Getting quotas for user 046cf5e98eca41c0a532e84f777efaab and project 8e5aad4353bf4dc2ba841d971f7212f2. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:13:50.392421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:13:50.394704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:13:50.442434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a98d9ad-3a26-49ab-ab82-4c77780bd9f3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.700919 Jul 11 16:13:50.448507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1562/3054] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 11 16:13:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 16:13:50.455105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:50.455868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:50.475726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:50.483963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45de8b65-e609-4097-ada9-643c076033ad tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.168395 Jul 11 16:13:50.484574 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1493/3055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:50.511341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:50.519327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:50.520954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:50.522149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9e38abe0-00f8-4959-8080-2878fd600a3d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1281 microversion: 2.20 time: 0.072560 Jul 11 16:13:50.522710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1563/3056] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:50 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:13:50.583012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:50.583626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:50.589862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.590314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.591066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:50.591500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:50.720843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:50.724420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:50.730014 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1eee7b37-4f12-47a5-96c7-3dc98c9311bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.151249 Jul 11 16:13:50.730758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1494/3057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:50 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:51.500878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:51.501460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:51.508854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.509299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.510068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.510814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.541954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:51.543316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:51.546324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:51.554692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.555220 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.556011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.556507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.631323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:51.642504 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:51.644428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:51.645660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-691423fe-6709-4047-accf-67502f43b269 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1351 microversion: 2.20 time: 0.109133 Jul 11 16:13:51.646880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1495/3058] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:51 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:13:51.702863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:51.711588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a0432482-f27c-49f7-9b24-4de8f29d3496 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.214828 Jul 11 16:13:51.712190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1564/3059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:51.748258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:51.748904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:51.755524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.755926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.757398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:51.757851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:51.891649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:51.900492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e36e06ca-ee5b-4168-b7ac-81c8f2ad4de8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156229 Jul 11 16:13:51.901073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1496/3060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:51 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:52.664775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:52.666068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:52.673189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.673901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.674976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.675721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.730139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:52.730758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:52.739934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.740698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.741637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.742238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.861100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:52.875176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:52.877279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:52.878492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-659b347c-3cff-4915-b53d-b4b19605345c tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1407 microversion: 2.20 time: 0.218334 Jul 11 16:13:52.879384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1565/3061] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:52 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:52.892231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-8552adf6-4d8e-4bf0-8dfd-3c258b3a3491 req-021cc7a6-4f03-4394-9a83-522c10e7e422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1c6501-eab9-43c1-bd04-2cd83670e1f6", "tag": "29f3fd8c-c9d3-4aab-a602-006f32177c7e"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:13:52.903209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8552adf6-4d8e-4bf0-8dfd-3c258b3a3491 req-021cc7a6-4f03-4394-9a83-522c10e7e422 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.904090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-8552adf6-4d8e-4bf0-8dfd-3c258b3a3491 req-021cc7a6-4f03-4394-9a83-522c10e7e422 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.920246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-8552adf6-4d8e-4bf0-8dfd-3c258b3a3491 req-021cc7a6-4f03-4394-9a83-522c10e7e422 service nova] Creating event network-changed:29f3fd8c-c9d3-4aab-a602-006f32177c7e for instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 on hv-cinder-79760 Jul 11 16:13:52.929452 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-8552adf6-4d8e-4bf0-8dfd-3c258b3a3491 req-021cc7a6-4f03-4394-9a83-522c10e7e422 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Jul 11 16:13:52.930639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1566/3062] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:13:52.939838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:52.940830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:52.952531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.952984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.953963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:52.954732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:52.957960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:52.967700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-08221cb3-f479-4667-9b34-380e3033cd82 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.242363 Jul 11 16:13:52.968738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1497/3063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:53.109683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:53.118609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4b421d87-11d0-4282-baaa-d668c6f29717 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.186628 Jul 11 16:13:53.119204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1567/3064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:53.902478 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:53.903408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:53.914988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:53.915745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:53.917029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:53.917745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:53.985227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:53.985946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:53.992554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:53.992997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:53.993751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:53.994178 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:54.096265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:54.105435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:54.106958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:54.108053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2d1be1c5-c7a1-4ac8-a38d-d1bb3960aa4d tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1407 microversion: 2.20 time: 0.212678 Jul 11 16:13:54.108641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1498/3065] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:53 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:54.135234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:54.135959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:54.142461 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:54.142907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:54.143654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:54.144052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:54.144629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:54.152975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c27f339d-e5b9-43ab-873e-e4ae7c2c3818 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.171630 Jul 11 16:13:54.153513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1568/3066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:13:54.278239 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:54.286473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74fed8ef-9292-4329-b9d3-a63cbd73b74e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.155367 Jul 11 16:13:54.287059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1499/3067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:54 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:55.137287 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:55.138683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:55.148667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.149119 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.149890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.150325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.170124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:55.170721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:55.177368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.178259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.179147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.179583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.357911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:55.362352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:55.366667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:55.368261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:55.369484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e7891f60-f290-4535-89db-de458874b90b tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1407 microversion: 2.20 time: 0.238862 Jul 11 16:13:55.370128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1569/3068] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:55 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:55.374941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:55.375615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:55.377127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c2d5d0b-22ed-440d-859a-dca9ce7ae594 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.210298 Jul 11 16:13:55.378101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1500/3069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:55.384107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.384645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.385462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:55.385978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:55.516551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:55.524801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8167dc2f-a245-476a-b479-6f96fd920108 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.153467 Jul 11 16:13:55.525366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1570/3070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:56.391635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:56.392787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:56.397874 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:56.398889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:56.405480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.406250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.407520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.408322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.410170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.410913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.412160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.412844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.616066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:56.619514 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:56.624284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83fa36cd-8a3d-4db3-a0b5-7573bfce6f50 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.232841 Jul 11 16:13:56.625105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1571/3071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:56 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:56.627851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:56.629397 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:56.629567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:56.630222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:56.630497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f5417d0d-456f-4875-aadd-34bd1915b8a5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1407 microversion: 2.20 time: 0.245631 Jul 11 16:13:56.631360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1501/3072] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:56 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:56.636501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.636945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.637691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:56.638124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:56.774031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:56.782046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1a8723e2-adba-4998-8c91-dd23e7b563f6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156048 Jul 11 16:13:56.782640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1572/3073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:56 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:57.129417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-6b53dd42-8744-41fa-a960-c65fafaadc33 req-e001b0ed-344b-4591-bec5-7ad955f1cfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1c6501-eab9-43c1-bd04-2cd83670e1f6", "name": "network-vif-plugged", "status": "completed", "tag": "29f3fd8c-c9d3-4aab-a602-006f32177c7e"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:13:57.138619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-6b53dd42-8744-41fa-a960-c65fafaadc33 req-e001b0ed-344b-4591-bec5-7ad955f1cfd9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.139087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-6b53dd42-8744-41fa-a960-c65fafaadc33 req-e001b0ed-344b-4591-bec5-7ad955f1cfd9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.151557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-6b53dd42-8744-41fa-a960-c65fafaadc33 req-e001b0ed-344b-4591-bec5-7ad955f1cfd9 service nova] Creating event network-vif-plugged:29f3fd8c-c9d3-4aab-a602-006f32177c7e for instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 on hv-cinder-79760 Jul 11 16:13:57.156683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-6b53dd42-8744-41fa-a960-c65fafaadc33 req-e001b0ed-344b-4591-bec5-7ad955f1cfd9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095032 Jul 11 16:13:57.157241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1502/3074] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:13:57.645811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:57.646784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:57.652417 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:57.653129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:57.653964 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.654370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.655240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.655697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.659404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.659846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.660614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.661039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.850946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:57.853799 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:57.854474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:57.859606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d1fb1ef-d553-44b6-b757-3331e7d9ae4f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.220596 Jul 11 16:13:57.860186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1573/3075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:57.863289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:57.864823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:57.866557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6315110-dcf0-443e-b10b-f5735e0dddc2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1407 microversion: 2.20 time: 0.219624 Jul 11 16:13:57.867252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1503/3076] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:57 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:57.872682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:57.873332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:57.879795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.880238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:57.881071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:57.881704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:58.009932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:58.017959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66f40ee6-9546-479a-b2bf-f6a314690ad1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.150314 Jul 11 16:13:58.018549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1574/3077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:57 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:58.876708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:58.877326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:58.884541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:58.884892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:58.885034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:58.885482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:58.885647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:58.886073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:58.892246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:58.892732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:58.893487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:58.893931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:59.083936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:59.088132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:59.094434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1717042d-8d86-4616-b18d-803c54fc34bc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.221668 Jul 11 16:13:59.095012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1504/3078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:13:59.098876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:59.099601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:59.100408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:59.100775 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:59.101819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e46150be-3ceb-46a4-aa3d-74d0d29d4ee5 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1598 microversion: 2.20 time: 0.221254 Jul 11 16:13:59.102371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1575/3079] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:13:58 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1598 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:13:59.106903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:59.107349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:59.108111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:59.108582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:59.119214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:13:59.119710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:13:59.125984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:59.126439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:59.127203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:13:59.127655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:13:59.502530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91620bc8-5d43-4e30-bd8e-32e8e347311a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.387233 Jul 11 16:13:59.506511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1576/3080] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 11 16:13:59 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6/os-interface => generated 284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:13:59.545384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:13:59.553617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-058702bf-04ee-4afe-9e98-abb45b178344 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.457424 Jul 11 16:13:59.554195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1505/3081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:13:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:00.112667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:00.113317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:00.119659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:00.120108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:00.120899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:00.121326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:00.252324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:00.260764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d45eec6b-e028-40dd-a908-e3dc3a4470a9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.152628 Jul 11 16:14:00.261346 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1577/3082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:00.522196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-e4831385-7c4d-49a6-989e-6e0dcf31bdec req-2aa19214-601f-4dbe-a84b-eb90f657ab51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1c6501-eab9-43c1-bd04-2cd83670e1f6", "tag": "29f3fd8c-c9d3-4aab-a602-006f32177c7e"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:14:00.531453 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e4831385-7c4d-49a6-989e-6e0dcf31bdec req-2aa19214-601f-4dbe-a84b-eb90f657ab51 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:00.531894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e4831385-7c4d-49a6-989e-6e0dcf31bdec req-2aa19214-601f-4dbe-a84b-eb90f657ab51 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:00.544165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-e4831385-7c4d-49a6-989e-6e0dcf31bdec req-2aa19214-601f-4dbe-a84b-eb90f657ab51 service nova] Creating event network-changed:29f3fd8c-c9d3-4aab-a602-006f32177c7e for instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 on hv-cinder-79760 Jul 11 16:14:00.549339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-e4831385-7c4d-49a6-989e-6e0dcf31bdec req-2aa19214-601f-4dbe-a84b-eb90f657ab51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Jul 11 16:14:00.552019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1506/3083] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:14:00.571023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:00.571639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:00.573753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:00.574851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=12 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:00.580389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:00.580860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:00.581942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:00.582562 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:00.722718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:00.732474 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c03da458-0e42-4088-a0d0-96cfa588d1e0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165456 Jul 11 16:14:00.733032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1578/3084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:00 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:01.279484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:01.280215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:01.286976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:01.287424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:01.288179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:01.288641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:01.422178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:01.430868 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1ce859d-730d-4af8-9a01-4854b422a02a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.155656 Jul 11 16:14:01.431457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1507/3085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:01.754056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:01.754961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:01.762664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:01.763113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:01.763866 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:01.764324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:01.897046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:01.905073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ffa29487-0d6a-4291-bad9-7a4f447b2c20 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157730 Jul 11 16:14:01.905649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1579/3086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:01 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:02.451436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:02.452367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:02.464527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:02.465276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:02.466570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:02.467291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:02.609752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:02.618366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-62164248-b71e-42c3-a485-9e425cc28ba7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173594 Jul 11 16:14:02.619047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1508/3087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:02 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:02.926707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:02.927844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:02.934708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:02.935151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:02.935905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:02.936394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:03.066582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:03.075006 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e33c9856-2ba0-497d-89c0-ba183cf66805 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.155003 Jul 11 16:14:03.075579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1580/3088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:02 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:03.637209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:03.637820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:03.644935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:03.645256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:03.646231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:03.646889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:03.783904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:03.793639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-735ca890-ed63-42db-afea-537d6ac3ed48 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160134 Jul 11 16:14:03.794559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1509/3089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:04.096859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:04.097891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:04.105748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:04.106195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:04.106951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:04.107389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:04.248339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:04.256754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-90ec6428-c4fc-49ed-9516-52e0a77d86e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166361 Jul 11 16:14:04.257302 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1581/3090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:04.816770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:04.817378 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:04.824464 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:04.824916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:04.825674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:04.826188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:04.964759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:04.973229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7eaf90f2-a968-4e31-a40c-360bee8c6461 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160550 Jul 11 16:14:04.973811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1510/3091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:05.284038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:05.285131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:05.294395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:05.294854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:05.295598 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:05.296036 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:05.437611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:05.448370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ac2e14b5-32f7-431b-9607-3841a544f98e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171035 Jul 11 16:14:05.448863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1582/3092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:06.001027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:06.001926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:06.011660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:06.012100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:06.012893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:06.013319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:06.159149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:06.172327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7c8543c3-ce42-4b33-9ce7-0c35af11792a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.178399 Jul 11 16:14:06.172956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1511/3093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:06.473398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:06.474133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:06.482466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:06.483072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:06.483984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:06.484462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:06.639789 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:06.649963 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52261feb-084d-461b-818b-55f851da99e9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185747 Jul 11 16:14:06.650536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1583/3094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:06 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:07.193481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:07.194219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:07.203500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:07.204162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:07.205392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:07.206390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:07.369709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:07.374608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:07.384097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29d140ee-1368-427f-bf6f-db73594e55ba tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.195504 Jul 11 16:14:07.384935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1512/3095] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:07.678129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:07.679293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:07.691048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:07.691800 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:07.693145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:07.693906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:07.841597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:07.852282 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b56e41cc-6165-49f2-976a-eb9790c61b30 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180566 Jul 11 16:14:07.852895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1584/3096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:07 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:08.409963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:08.410954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:08.418861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:08.419307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:08.420049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:08.420513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:08.563758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:08.572278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4abf218d-f07c-4585-8585-26f677e70992 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.168797 Jul 11 16:14:08.572885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1513/3097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:08 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:08.875231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:08.876334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:08.887858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:08.888692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:08.889956 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:08.890692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:09.034140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:09.043194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ef1721ab-9080-4aa8-947e-162333d26d5e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174629 Jul 11 16:14:09.043824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1585/3098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:09.594993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:09.595847 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:09.606979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:09.607738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:09.609016 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:09.609739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:09.754198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:09.763649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-38f11376-d4fb-47ec-900f-2ab62942871a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175435 Jul 11 16:14:09.764218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1514/3099] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:10.061373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:10.061992 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:10.070530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:10.071070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:10.072137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:10.072607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:10.220424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:10.228747 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-001ab7bb-d2dc-4ea4-a04a-beb9193fe259 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171374 Jul 11 16:14:10.229319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1586/3100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:10.784570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:10.785546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:10.793540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:10.793985 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:10.794735 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:10.795165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:10.935884 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:10.944017 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-df19a05d-d588-4082-b4d2-63260448f1c4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165770 Jul 11 16:14:10.944646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1515/3101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:11.246382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:11.246999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:11.254136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:11.254592 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:11.255381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:11.255821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:11.398220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:11.406655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0382c719-a4da-48b7-8eac-a5c122d3811f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164396 Jul 11 16:14:11.407244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1587/3102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:11.962512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:11.963139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:11.970030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:11.970518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:11.971279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:11.971714 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:12.106708 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:12.116227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-68dfa752-5421-45b3-8756-8f0f9855abf8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.157351 Jul 11 16:14:12.117268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1516/3103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:12.428199 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:12.429441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:12.437158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:12.437603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:12.438362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:12.438791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:12.585490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:12.595092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7f6725a4-6aab-4104-a7b1-78e2aadaa908 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173430 Jul 11 16:14:12.595680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1588/3104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:12 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:13.141191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:13.142161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:13.152434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:13.152936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:13.153684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:13.154112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:13.295178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:13.303671 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-59013780-dadf-42b0-b2f5-69cba7227c56 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169187 Jul 11 16:14:13.304319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1517/3105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:13.623374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:13.624450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:13.635907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:13.636490 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:13.637409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:13.637836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:13.788998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:13.797252 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7b7a8a46-b5a6-42ad-b650-b839166ffd8a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181207 Jul 11 16:14:13.797820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1589/3106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:14.325435 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:14.326168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:14.334056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:14.334550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:14.335385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:14.335861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:14.485639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:14.493995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1676fcd-d21b-42c5-9275-5c8d56cda5c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.174390 Jul 11 16:14:14.494553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1518/3107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:14.818745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:14.819354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:14.826647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:14.827096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:14.827848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:14.828277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:14.971288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:14.977018 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:14.983688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-447165b4-7f9d-4c1c-a2dd-e3eb2f4ce67e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168939 Jul 11 16:14:14.984249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1590/3108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:15.512215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:15.512916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:15.519998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:15.520470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:15.521264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:15.521688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:15.651724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:15.660286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-270a6938-b247-49f2-b358-fea44e79cfec tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.152551 Jul 11 16:14:15.660928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1519/3109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:15 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:16.005339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:16.006342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:16.018016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:16.018770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:16.020022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:16.020806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:16.155556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:16.164472 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d6d9ad2-297f-4c40-9c7c-268e93378cb9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165697 Jul 11 16:14:16.165055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1591/3110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:15 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:16.678952 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:16.679677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:16.688551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:16.689097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:16.690040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:16.690573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:16.833065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:16.841390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ae8e7996-d1f8-4505-a919-d80d3836f831 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.167371 Jul 11 16:14:16.841970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1520/3111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:17.186311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:17.187320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:17.199946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:17.200439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:17.201220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:17.201665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:17.352485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:17.361054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-270903b3-e154-4cef-84cc-2efd6d6ee8ab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181181 Jul 11 16:14:17.361635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1592/3112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:17 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:17.862389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:17.863467 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:17.872888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:17.873326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:17.874069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:17.874494 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:18.022621 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:18.033328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10a9707b-0c0f-4a41-b3a5-5d144e98d589 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.177486 Jul 11 16:14:18.033900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1521/3113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:18.382907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:18.383839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:18.387113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=82 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:18.396061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:18.396840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:18.398080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:18.398793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:18.548489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:18.556787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d956dcfd-cf03-4ab1-b204-95c7fdc1c942 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180407 Jul 11 16:14:18.557367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1593/3114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:19.054789 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:19.055751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:19.063580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:19.064028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:19.064845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:19.065288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:19.209058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:19.217491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4472556-51ba-481d-a37b-badbb84d4357 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169472 Jul 11 16:14:19.218438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1522/3115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:19.576639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:19.577272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:19.587342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:19.587799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:19.588612 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:19.589132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:19.732478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:19.741075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9b90e077-0ced-4061-9308-38f8639400e2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169272 Jul 11 16:14:19.741649 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1594/3116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:19 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:20.236002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:20.236640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:20.243560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:20.243998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:20.244800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:20.245224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:20.382572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:20.391988 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af4be625-95f9-455d-811c-b87b8767e739 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.159945 Jul 11 16:14:20.392585 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1523/3117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:20.763374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:20.764255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:20.775353 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:20.776089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:20.777507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:20.777988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:20.916836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:20.925413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-621b91f2-ee64-4200-a463-71fd9f30dc7e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169445 Jul 11 16:14:20.925989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1595/3118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:21.413571 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:21.414579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:21.425772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:21.426519 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:21.427777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:21.428547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:21.572901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:21.582160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-279646fc-91ab-4dff-ab86-cb129f00587c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175355 Jul 11 16:14:21.582728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1524/3119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:21 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:21.944518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:21.945264 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:21.953188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:21.953634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:21.954432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:21.954868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:22.111527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:22.123471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1ad0630f-6671-4d1f-92d4-5984b787d8e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.183844 Jul 11 16:14:22.124031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1596/3120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:21 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:22.603762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:22.604767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:22.607695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=60 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:22.613955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:22.614389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:22.615137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:22.615555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:22.755624 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:22.763995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12c953cb-90d8-420e-930c-135fd1ebe9a2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166858 Jul 11 16:14:22.764619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1525/3121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:23.144737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:23.145787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:23.156566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:23.157131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:23.158266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:23.158925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:23.303064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:23.311405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44aaea99-a579-4e29-ab96-10afa97d5c76 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173294 Jul 11 16:14:23.311982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1597/3122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:23.790706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:23.791773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:23.802777 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:23.803564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:23.804895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:23.805612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:23.940439 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:23.948499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5bf8b6db-d19e-47ac-939d-d706f69cdc8c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164422 Jul 11 16:14:23.949074 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1526/3123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:24.332048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:24.332929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:24.341785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:24.342229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:24.343068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:24.343571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:24.484217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:24.492526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-04ae699a-6e3e-4699-9c2b-7b687fae0728 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166333 Jul 11 16:14:24.493092 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1598/3124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:24.975406 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:24.976446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:24.987411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:24.988204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:24.989471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:24.990191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:25.133250 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:25.142132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11973082-a1ed-4a10-af1d-70434dd5e163 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173220 Jul 11 16:14:25.142719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1527/3125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:25.513791 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:25.514395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:25.522031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:25.522529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:25.523313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:25.523777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:25.673177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:25.685672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-801163ac-655a-44e7-a92f-c712357ed027 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178159 Jul 11 16:14:25.686589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1599/3126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:25 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:26.163141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:26.164130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:26.172733 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:26.173175 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:26.173920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:26.174342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:26.315445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:26.325746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f537bbb9-f774-452e-964c-e77c42e95855 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169216 Jul 11 16:14:26.326326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1528/3127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:26.713103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:26.714177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:26.721832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:26.722268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:26.723031 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:26.723466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:26.857911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:26.866279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-26cf46a4-7928-440e-b86b-d30b071c1201 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.160598 Jul 11 16:14:26.866856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1600/3128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:27.346411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:27.347441 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:27.357692 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:27.358139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:27.358894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:27.359326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:27.378060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:27.501888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:27.510113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12e762fe-ce4b-4fd0-a241-a522e6553fe7 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.170201 Jul 11 16:14:27.510685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1529/3129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:27.889672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:27.890667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:27.901683 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:27.902494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:27.903796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:27.904273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:28.055125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:28.067446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ece8f0c8-7ca3-43d7-b2bc-44815f1be473 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.184345 Jul 11 16:14:28.068261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1601/3130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:27 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:28.531043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:28.531620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:28.538518 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:28.539022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:28.539772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:28.540190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:28.676929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:28.685083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8bbd2f56-45ce-4439-a1c3-05261288a49d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160367 Jul 11 16:14:28.685653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1530/3131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:28 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:29.092012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:29.092931 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:29.100724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:29.101171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:29.101966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:29.102402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:29.244496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:29.252762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cf73bed6-e899-4d68-b7e6-a5cdf81c4720 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167407 Jul 11 16:14:29.253332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1602/3132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:29.706427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:29.707198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:29.715843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:29.716329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:29.717295 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:29.717830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:29.854157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:29.866404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-636ad2e7-6e5e-44c7-ae48-7e7cb5cead88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166251 Jul 11 16:14:29.867193 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1531/3133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:30.155832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:30.156593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:30.163554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.164021 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:30.164820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.165276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:30.190681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80ccee2f-34b9-4e10-9286-bf7aaf039ff0 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6/ips" status: 200 len: 151 microversion: 2.20 time: 0.040949 Jul 11 16:14:30.190681 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1603/3134] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 11 16:14:30 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 16:14:30.273994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:30.274994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:30.285329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.286063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:30.287304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.288012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:30.425603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:30.437653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e148eda-e9ee-498f-818a-8b7946408e34 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169909 Jul 11 16:14:30.438432 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1532/3135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:30.892162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:30.893383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:30.903915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.904716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:30.906000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:30.906437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:31.041444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:31.050038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3d595edd-a4b2-4c85-a432-b77f2568ef08 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165178 Jul 11 16:14:31.050633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1604/3136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:31.459944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:31.460895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:31.470652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:31.471100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:31.471845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:31.472269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:31.607154 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:31.619294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9e29d75-326f-463b-8f7b-9542521ff8a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166433 Jul 11 16:14:31.619983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1533/3137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:31 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:32.069011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:32.069701 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:32.077059 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:32.077510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:32.078275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:32.078708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:32.225499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:32.233864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c27f6d03-3fc9-43cf-84bc-5a51ca3e170c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.168867 Jul 11 16:14:32.234463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1605/3138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:32.643171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:32.643835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:32.651010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:32.651448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:32.652203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:32.652659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:32.785311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:32.798038 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-255fda7d-4d8b-4d9e-91e5-aea640e508f9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161484 Jul 11 16:14:32.798719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1534/3139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:33.251440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:33.252554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:33.259310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:33.259752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:33.260556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:33.260988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:33.415816 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:33.424827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8ab3a4c7-6642-49ea-be9d-355860792a5c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.177301 Jul 11 16:14:33.425392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1606/3140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:33.819333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:33.820353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:33.832444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:33.833234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:33.834472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:33.835189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:33.973272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:33.981430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-83f38e12-f416-4408-8359-3ace6a368dd0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168807 Jul 11 16:14:33.982005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1535/3141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:33 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:34.446479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:34.447361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:34.459093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:34.459865 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:34.461164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:34.461880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:34.597158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:34.600645 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:34.605704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-18df4524-b74e-48a3-b748-7e1b4707d91b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166025 Jul 11 16:14:34.606283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1607/3142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:34 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:35.003042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:35.003846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:35.013947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:35.014677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:35.015773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:35.016488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:35.155159 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:35.163318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3b3510ec-1399-4816-a4a1-cebade3b8ec2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166745 Jul 11 16:14:35.163895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1536/3143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:35.628467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:35.629557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:35.641572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:35.642325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:35.643340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:35.643775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:35.788607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:35.801929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e1454a9b-75b4-4ace-9bfc-a44c536472f8 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.180507 Jul 11 16:14:35.802712 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1608/3144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:36.190544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:36.191520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:36.202451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:36.203190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:36.204491 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:36.206302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:36.352335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:36.361479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-032c47d3-5148-4d9e-8a7d-d04327b27a9b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177495 Jul 11 16:14:36.362150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1537/3145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:36.824613 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:36.825244 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:36.833258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:36.833705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:36.834465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:36.834899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:37.019043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:37.027731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-10f57537-0ce7-4aab-9b50-e4d75bb121ce tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.207176 Jul 11 16:14:37.028327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1609/3146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:37.382401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:37.383227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:37.391984 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:37.392699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:37.394082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:37.397353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:37.532974 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:37.541199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7160f143-f14c-47d2-989c-99e22a61df33 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164581 Jul 11 16:14:37.541771 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1538/3147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:37 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:38.049132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:38.050315 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:38.061070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:38.061839 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:38.063170 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:38.063943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:38.215929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:38.225758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3458e64d-d4bb-42f0-b296-0af12e849698 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.183315 Jul 11 16:14:38.226326 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1610/3148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:38.558962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:38.559560 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:38.566638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:38.567088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:38.567891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:38.568345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:38.701524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:38.711549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-949b136e-b105-4cae-97bf-a6eab4a1bc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156560 Jul 11 16:14:38.712123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1539/3149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:39.247263 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:39.248081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:39.259348 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:39.260032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:39.261221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:39.261881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:39.402901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:39.417049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-491dac46-45fc-4ae1-b30b-134f0a763521 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175769 Jul 11 16:14:39.417917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1611/3150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:39.733223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:39.734112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:39.745204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:39.745959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:39.747190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:39.747958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:39.891045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:39.899727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f73aeef-228f-4480-adad-fa55a0cab1d9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173234 Jul 11 16:14:39.900321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1540/3151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:40.439316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:40.440241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:40.447853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:40.448240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:40.449029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:40.449464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:40.591152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:40.599395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b61e55f8-920e-4b70-83ee-079a2bc1ce90 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166794 Jul 11 16:14:40.599978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1612/3152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:40.921594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:40.922597 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:40.930604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:40.931046 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:40.931791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:40.932212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:41.071750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:41.082515 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4c62350d-716f-4285-be46-e661187cf64c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167469 Jul 11 16:14:41.083084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1541/3153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:41.618656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:41.619365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:41.627257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:41.627774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:41.628714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:41.629255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:41.765891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:41.774259 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5b00d6c4-a288-4537-81fc-13c210265988 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160416 Jul 11 16:14:41.774824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1613/3154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:41 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:42.107359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:42.108386 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:42.119425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:42.120153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:42.121451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:42.122171 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:42.266010 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:42.274611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2b46d679-d2c2-4e1b-b56c-14a4df0d7363 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173730 Jul 11 16:14:42.275212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1542/3155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:42 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:42.799362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:42.800489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:42.811653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:42.812434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:42.813709 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:42.814437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:42.947538 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:42.956563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-201f33cd-a03f-4d64-9ca2-46891a784d64 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163446 Jul 11 16:14:42.957275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1614/3156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:43.295997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:43.297001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:43.308034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:43.308811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:43.310056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:43.310768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:43.454438 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:43.463695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-df1182af-93f5-4da7-8d6a-aaf5eb253cb8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174169 Jul 11 16:14:43.464269 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1543/3157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:43.977417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:43.978142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:43.986206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:43.986734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:43.987620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:43.988132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:44.131781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:44.140174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-95d24925-e0d3-4089-b413-08b6b79aad51 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169211 Jul 11 16:14:44.140794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1615/3158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:44.485630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:44.486545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:44.494987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:44.495428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:44.496172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:44.496630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:44.629231 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:44.637632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ae0c833-6f53-40b2-814b-8649a23950a5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158425 Jul 11 16:14:44.638181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1544/3159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:44 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:45.160840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:45.161727 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:45.172624 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:45.173417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:45.174687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:45.176054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:45.320047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:45.328575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4a9cad1a-2306-4575-a836-302c2fb0dd7b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.174414 Jul 11 16:14:45.329160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1616/3160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:45.659278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:45.660276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:45.668471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:45.668913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:45.669658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:45.670087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:45.802065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:45.811037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77372cf1-f69d-4482-8429-44bff9761bcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158366 Jul 11 16:14:45.811619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1545/3161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:46.349785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:46.350487 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:46.357550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:46.357998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:46.358748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:46.359180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:46.495194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:46.503369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-072fa91e-46c1-4e78-968c-def493d707c3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160131 Jul 11 16:14:46.503951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1617/3162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:46.833481 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:46.834348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:46.841549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:46.841995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:46.842744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:46.843169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:46.847127 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:46.982391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:46.994420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5f05e996-4689-48ef-a4ec-d215f7f2d13b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167587 Jul 11 16:14:46.995551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1546/3163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:46 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:47.527658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:47.528471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:47.537294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:47.538047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:47.539189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:47.539762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:47.682677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:47.690981 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-be682dee-ff4a-4d99-9bec-67ae4fa25441 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.168914 Jul 11 16:14:47.691557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1618/3164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:47 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:48.017627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:48.018412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:48.026357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:48.026909 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:48.027864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:48.028437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:48.175667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:48.184325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-73f98cab-6a2b-44a3-814e-94517e1c85df tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171805 Jul 11 16:14:48.184916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1547/3165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:48.850084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:48.850670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:48.853550 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=52 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:48.861626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:48.862299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:48.863385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:48.863967 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:49.008833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:49.020895 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-87d3af7c-924e-46af-ae37-3c18613b2b3c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.314908 Jul 11 16:14:49.021796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1619/3166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:49.203066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:49.203672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:49.211261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:49.211703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:49.212526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:49.212953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:49.364964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:49.376100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77e25123-40e4-47f3-871e-6b92844f81f1 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176982 Jul 11 16:14:49.376727 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1548/3167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:50.041801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:50.042605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:50.051515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:50.052159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:50.053505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:50.054094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:50.191362 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:50.199656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0d387397-431d-4bd2-a8fb-6060e283ec96 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163646 Jul 11 16:14:50.200211 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1620/3168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:50 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:50.398139 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:50.398834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:50.407297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:50.407821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:50.408844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:50.409398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:50.552627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:50.560947 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58ac9acc-7a62-4d92-9a81-525d2ad80d06 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169562 Jul 11 16:14:50.561495 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1549/3169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:50 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:51.217539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:51.218153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:51.225155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:51.225596 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:51.226350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:51.226775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:51.360922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:51.370395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a2f36a4a-7b0e-48ba-85b9-0755bef6acc9 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.156573 Jul 11 16:14:51.371187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1621/3170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:51 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:51.581776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:51.582541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:51.591670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:51.592270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:51.593300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:51.593867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:51.742738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:51.751288 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-597efc34-fe7b-4694-90c8-6ecca3be9ef5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175590 Jul 11 16:14:51.751861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1550/3171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:51 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:52.397254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:52.398438 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:52.409502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:52.410256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:52.411786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:52.412873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:52.558721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:52.567107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae8dbf81-a242-428e-a8d8-d78609b187e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.176462 Jul 11 16:14:52.567695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1622/3172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:52 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:52.773416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:52.774020 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:52.776393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=52 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:52.782240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:52.782703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:52.783684 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:52.784196 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:52.922304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:52.937210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bdf74fd9-046e-4726-a4ad-ccc3637a2891 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170341 Jul 11 16:14:52.937802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1551/3173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:53.587217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:53.587807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:53.595043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:53.595501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:53.596261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:53.596742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:53.751582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:53.760191 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7ed2c752-8e9b-492b-b5a8-b6b9c1131795 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.177958 Jul 11 16:14:53.760811 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1623/3174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:53 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:53.961573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:53.962429 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:53.973583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:53.974323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:53.975765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:53.976227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:54.106732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:54.115760 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5270d0b7-1313-471f-81fa-0b3bcc9a45a6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161333 Jul 11 16:14:54.116354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1552/3175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:53 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:54.783495 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:54.784413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:54.795767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:54.796594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:54.797859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:54.798588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:54.820446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:54.938688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:54.951130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6f24e9b4-f9fb-4cd5-95f2-f63b853afa88 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175891 Jul 11 16:14:54.951891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1624/3176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:54 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:55.136843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:55.137601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:55.146008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:55.146565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:55.147502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:55.148061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:55.287535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:55.295657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-230cf997-8931-4519-980d-5eeb534b0448 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165093 Jul 11 16:14:55.296243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1553/3177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:55.977977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:55.979020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:55.986664 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:55.987118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:55.987891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:55.988336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:56.119586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:56.127777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0dbdfa63-589c-49ef-9755-04b33718e79d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.156446 Jul 11 16:14:56.128380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1625/3178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:55 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:56.320284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:56.320994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:56.328368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:56.328823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:56.329575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:56.330005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:56.472259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:56.480319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-171ec484-b96c-48dc-9aa6-7ed58a81340c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164164 Jul 11 16:14:56.480911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1554/3179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:56 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:57.149101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:57.150060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:57.157704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:57.158157 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:57.158925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:57.159359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:57.293091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:57.303961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a7e80bd0-e683-49e8-8496-66962b8cdcea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160961 Jul 11 16:14:57.304814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1626/3180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:57 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:57.500904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:57.501852 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:57.512039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:57.512523 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:57.513245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:57.513703 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:57.648130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:57.657004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a51847c2-6432-410a-9f25-9a001aeba7ac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163012 Jul 11 16:14:57.657554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1555/3181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:57 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:58.325383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:58.325987 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:58.333489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:58.333944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:58.334879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:58.335336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:58.473962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:58.486017 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d7386018-d9a5-45db-b402-29232e227a29 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166343 Jul 11 16:14:58.486860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1627/3182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:58 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:58.678321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:58.679337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:58.687549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:58.687996 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:58.688792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:58.689211 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:58.837366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:58.846644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-09667219-065c-4529-b0ca-8abec9541f85 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174927 Jul 11 16:14:58.847265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1556/3183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:58 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:59.503652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:59.504250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:59.511855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:59.512316 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:59.513101 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:59.513540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:59.652756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:14:59.665350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a453406-f600-4952-a536-c74c7890fd7f tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165485 Jul 11 16:14:59.666152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1628/3184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:59 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:14:59.864668 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:14:59.865309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:14:59.872712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:59.873163 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:14:59.873925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:14:59.874362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:00.013940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:00.022207 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d029ec10-168c-4524-8d4d-5db27a8f88de tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161655 Jul 11 16:15:00.022761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1557/3185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:14:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:00.686750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:00.687553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:00.696704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:00.697306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:00.698329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:00.698912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:00.853785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:00.862385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-203fbc69-ddfb-4387-b853-6d6a054fdc28 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.181788 Jul 11 16:15:00.862962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1629/3186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:00 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:01.039411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:01.040007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:01.047176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:01.047622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:01.048400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:01.048824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:01.184377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:01.193437 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-20cc8277-dd6f-4a66-bd4b-73b12a628170 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157965 Jul 11 16:15:01.193995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1558/3187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:01 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:01.883912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:01.884897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:01.896745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:01.897492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:01.898738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:01.899458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:02.038602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:02.051405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-21a3a31e-407c-4d60-b177-03a02078bdc4 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173794 Jul 11 16:15:02.052226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1630/3188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:01 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:02.216660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:02.217278 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:02.224262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:02.224747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:02.225509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:02.225944 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:02.360166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:02.373773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e3d41a03-a8fd-443f-9e7c-98a23f0bf898 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161162 Jul 11 16:15:02.374544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1559/3189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:02 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:03.073557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:03.074179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:03.081989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:03.082367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:03.083123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:03.083554 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:03.219068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:03.227608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8379db74-e22a-4b88-8a65-5f520fd4cc83 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160698 Jul 11 16:15:03.228189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1631/3190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:03 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:03.396927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:03.397656 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:03.406326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:03.406762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:03.407501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:03.407928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:03.551402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:03.559731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-337ac512-91eb-4ca1-95dc-099cb10f307a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167832 Jul 11 16:15:03.560630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1560/3191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:03 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:04.246543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:04.247187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:04.254575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:04.255015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:04.255775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:04.256246 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:04.392544 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:04.404633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-058d0a49-d90b-43e8-ab34-cfa64abd8931 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.162136 Jul 11 16:15:04.405215 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1632/3192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:04 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:04.578876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:04.580082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:04.587168 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:04.587640 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:04.588424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:04.588849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:04.723436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:04.731551 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-367d458c-8081-49c4-bc89-1b706438fde9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158025 Jul 11 16:15:04.732187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1561/3193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:05.430697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:05.431715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:05.442854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:05.443615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:05.445022 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:05.445651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:05.587446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:05.596768 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-64e4ba8e-cb1a-4354-ae2d-791fcee527ef tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.172592 Jul 11 16:15:05.597566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1633/3194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:05 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:05.755371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:05.756012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:05.762532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:05.762997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:05.764323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:05.764746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:05.898600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:05.902155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:05.907642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3af718db-d404-4a7d-a5a1-5ad29241c26c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156331 Jul 11 16:15:05.908195 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1562/3195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:06.618391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:06.619334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:06.628089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:06.628567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:06.629329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:06.629765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:06.774383 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:06.787933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b2f716f-6bc7-4ca6-8839-abc00cf60514 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.175823 Jul 11 16:15:06.788778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1634/3196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:06 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:06.930072 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:06.931019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:06.943039 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:06.943786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:06.945081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:06.945841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:07.083926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:07.092468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb98e4d7-c065-4ed3-afe0-afc156163608 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169662 Jul 11 16:15:07.093142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1563/3197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:06 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:15:07.810898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:07.811509 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:07.819238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:07.819707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:07.820533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:07.820938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:07.992662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:08.003256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cdab9f09-9362-4250-ad38-5b6e4d07acbc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.198551 Jul 11 16:15:08.003857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1635/3198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:07 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:08.112653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:08.113678 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:08.121626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:08.122069 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:08.122830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:08.123424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:08.262355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:08.270929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9fafe840-7a4c-4ab2-85bf-b24805ac41c9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163307 Jul 11 16:15:08.271505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1564/3199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:09.029080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:09.030153 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:09.042239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:09.042995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:09.044241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:09.045115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:09.190491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:09.198850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-390b2ff7-87b5-4227-a1f0-98452f50d5e2 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.176492 Jul 11 16:15:09.199422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1636/3200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:09 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:09.292116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:09.293090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:09.304555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:09.305329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:09.306520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:09.307225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:09.445579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:09.454390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2d088578-60be-49ad-ad54-fea0be9ac6bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168651 Jul 11 16:15:09.455044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1565/3201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:09 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:10.218980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:10.219528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:10.226330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:10.226778 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:10.227528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:10.227955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:10.368579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:10.377066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-94e81439-359e-42f3-995a-8f14c55e8bea tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163720 Jul 11 16:15:10.377640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1637/3202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:10 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:10.476959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:10.477820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:10.487745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:10.488188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:10.488962 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:10.489391 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:10.889812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:10.898420 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d0776a8d-1e34-49ff-806d-ed78d196dc24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.428251 Jul 11 16:15:10.898989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1566/3203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:11.396273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:11.397072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:11.405573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:11.406225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:11.407528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:11.408085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:11.541638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:11.549973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-02445f38-d74d-40fd-b955-69bcd26a3a4e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.158633 Jul 11 16:15:11.550549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1638/3204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:11 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:11.919293 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:11.920223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:11.927842 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:11.928311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:11.929036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:11.929512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:12.063317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:12.076617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-14e8c401-329a-464c-bae4-94e7dc267245 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163808 Jul 11 16:15:12.077452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1567/3205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:12.571279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:12.572471 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:12.582013 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:12.582462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:12.583230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:12.583667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:12.724443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:12.732742 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4ba97c41-0f06-432b-8559-e788adc7a27b tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.168064 Jul 11 16:15:12.733325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1639/3206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:12 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:13.097978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:13.098639 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:13.110834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:13.110834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:13.110834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:13.110834 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:13.249500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:13.258015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-808dcf46-b57b-4e03-9dc1-a6a22c21e447 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165525 Jul 11 16:15:13.258594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1568/3207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:13.752706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:13.753357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:13.760626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:13.761084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:13.761845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:13.762309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:13.901904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:13.910597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dd1bc06a-1486-4eb0-87c7-2b9fc1534586 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163629 Jul 11 16:15:13.911184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1640/3208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:13 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:14.278874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:14.279829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:14.289672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:14.290327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:14.291360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:14.291960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:14.426855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:14.440489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9133c530-cdd3-4261-8f62-76774fec0a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167662 Jul 11 16:15:14.441080 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1569/3209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:14.932011 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:14.933040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:14.944639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:14.945392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:14.946638 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:14.947366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:14.954298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:15.086982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:15.096217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-873af116-279e-4968-bc62-f45832f6aecc tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.170751 Jul 11 16:15:15.096828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1641/3210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:14 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:15.462617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:15.463251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:15.471395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:15.471833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:15.472619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:15.473048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:15.606191 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:15.614642 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb554afd-427f-4a59-b321-b3d3f8b88f26 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156692 Jul 11 16:15:15.615222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1570/3211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:15 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:16.118382 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:16.119355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:16.128802 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:16.129247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:16.130004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:16.130422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:16.267369 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:16.275971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1d8ed868-0607-4590-bd32-4a2ffe530cc6 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164454 Jul 11 16:15:16.276587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1642/3212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:16 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:16.635921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:16.636904 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:16.646161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:16.646608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:16.647352 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:16.647784 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:16.783751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:16.791958 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f3dc25f6-84e5-44bd-b9d7-473d60414114 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162530 Jul 11 16:15:16.792604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1571/3213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:16 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:17.298740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:17.299842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:17.306589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:17.307040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:17.307794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:17.308224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:17.452186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:17.466829 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-25ac4319-3153-4621-a834-5eea8c5ce54c tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.174738 Jul 11 16:15:17.467770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1643/3214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:17 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:17.813530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:17.814530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:17.826052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:17.826794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:17.828049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:17.828823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:17.960750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:17.969085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4bc34f1-cc9c-4965-8e96-1520bccd25bf tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162102 Jul 11 16:15:17.969670 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1572/3215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:17 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:18.490319 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:18.491210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:18.501689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:18.502675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:18.503434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:18.503863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:18.636046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:18.646675 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f7d49cfd-4c08-4ed5-b2a1-199d12d29a66 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163331 Jul 11 16:15:18.647226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1644/3216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:18 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:18.990976 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:18.992013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:19.002886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:19.003318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:19.004071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:19.004532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:19.153841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:19.162667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c49c1ee-8b05-4825-8f62-bf551746c146 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178385 Jul 11 16:15:19.163266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1573/3217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:19.664410 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:19.665065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:19.667367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=52 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:19.673129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:19.673566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:19.674327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:19.674751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:19.833665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:19.842028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c26b4fd-1841-46f6-9ae3-98f59808e63d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.181694 Jul 11 16:15:19.842935 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1645/3218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:19 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:20.184853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:20.185758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:20.196270 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:20.197009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:20.198169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:20.198832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:20.361795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:20.369793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1e835bb4-23ae-4e3d-9156-eecf7c6ce016 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.191647 Jul 11 16:15:20.370368 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1574/3219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:20.863373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:20.863986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:20.871171 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:20.871620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:20.872420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:20.872856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:21.026907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:21.039350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6a6847e-454d-4020-8706-3b527b2c36be tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.181563 Jul 11 16:15:21.040255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1646/3220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:20 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:21.391148 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:21.392044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:21.403229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:21.403995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:21.405316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:21.406030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:21.538333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:21.546857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a50c41e7-6550-4bd4-8f18-34792ae62d1b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162349 Jul 11 16:15:21.547436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1575/3221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:21 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:22.063357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:22.064228 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:22.071435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:22.071892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:22.072744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:22.073182 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:22.213555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:22.222035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-87deb196-ab17-480e-af3f-00f677f0c50a tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164210 Jul 11 16:15:22.222583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1647/3222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:22 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:22.568918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:22.569973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:22.581555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:22.582008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:22.582769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:22.583206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:22.736578 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:22.749276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-697f8628-97ae-4f95-96a6-65ab6b86bf05 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.186759 Jul 11 16:15:22.750096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1576/3223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:22 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:23.239481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:23.240097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:23.247162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:23.247620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:23.248416 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:23.248856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:23.391265 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:23.400028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-41601472-b3e1-4ec5-bc80-e4e046e8114d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164825 Jul 11 16:15:23.400653 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1648/3224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:23 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:23.773536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:23.774568 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:23.778227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=52 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:23.785946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:23.786396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:23.787156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:23.787592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:23.928338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:23.940813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a04ee88d-6aaf-4909-a0d4-34c7eb7cf23e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173591 Jul 11 16:15:23.941603 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1577/3225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:24.418135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:24.418772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:24.426213 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:24.426676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:24.427458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:24.427891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:24.568239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:24.578552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-17f78874-5fac-4d18-812b-c88f1e09e191 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.164320 Jul 11 16:15:24.579152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1649/3226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:24 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:24.968751 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:24.969765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:24.977234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:24.977682 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:24.978436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:24.978870 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:25.115396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:25.123694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a428b1da-90a8-4825-bf06-cb900fe52f9c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161526 Jul 11 16:15:25.124262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1578/3227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:25.600387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:25.601507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:25.612496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:25.612943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:25.613694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:25.614121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:25.754797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:25.763174 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ce0d0f9-17ba-4836-af57-4449ccc18bd5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.169889 Jul 11 16:15:25.763754 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1650/3228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:25 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:26.145324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:26.146256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:26.157555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:26.158434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:26.160480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:26.161274 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:26.184454 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:26.315615 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:26.323915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-779bcbc1-5bbf-45f3-92c0-5cc2b2d71fe2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185252 Jul 11 16:15:26.324521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1579/3229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:26.783469 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:26.784120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:26.791530 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:26.792010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:26.792851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:26.793314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:26.930082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:26.938466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ba3f7305-c3da-44e4-9696-72a8d8588264 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.161735 Jul 11 16:15:26.939046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1651/3230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:26 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:27.346132 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:27.346975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:27.354686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:27.355184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:27.356040 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:27.356562 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:27.494334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:27.502611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05fdcc19-a930-4b67-991e-389b21ac9210 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163205 Jul 11 16:15:27.503177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1580/3231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:27 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:27.957037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:27.957670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:27.964830 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:27.965277 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:27.966050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:27.966478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:28.103415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:28.112012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7417db71-0f73-420d-b8f8-ddc5b6459117 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.159447 Jul 11 16:15:28.112695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1652/3232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:27 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:28.523460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:28.524393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:28.535203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:28.535956 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:28.537248 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:28.538895 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:28.673719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:28.682021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1738c7ea-6e43-4318-882f-8cdfa96b67ba tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165349 Jul 11 16:15:28.682599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1581/3233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:28 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:29.129785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:29.130381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:29.138130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:29.139033 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:29.140247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:29.140937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:29.288763 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:29.300906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ae77e283-ca8a-4475-9c4e-1b08310c7492 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.176095 Jul 11 16:15:29.301453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1653/3234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:29 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:29.705683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:29.707033 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:29.718377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:29.719022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:29.720360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:29.721448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:29.874674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:29.887610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2b8ec52-0ba5-48b5-aa01-0fb493f14de2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.188445 Jul 11 16:15:29.888314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1582/3235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:30.285927 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:30.286497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:30.293716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.294173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.294936 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.295375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.318108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:30.318721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:30.321571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:15:30.325146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.325604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.326365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.326800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.408108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cbd0d196-78f5-4d71-9ecc-e455df158460 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 204 len: 0 microversion: 2.20 time: 0.127038 Jul 11 16:15:30.410177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1654/3236] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 16:15:30 2022] DELETE /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 16:15:30.419054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:30.419759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:30.426221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.426678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.427440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.427912 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.464969 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:30.473487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9928ba0a-e46f-4245-ab65-7fba064dcb4d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.159341 Jul 11 16:15:30.474077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1583/3237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:30 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:30.563357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:30.571976 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:30.573522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:30.574671 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e2a52655-3c21-4e92-8ca1-744f85d4bab1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1723 microversion: 2.20 time: 0.159851 Jul 11 16:15:30.575241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1655/3238] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:15:30 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 16:15:30.906643 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:30.907313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:30.914582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.915022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:30.915770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:30.916194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:31.062479 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:31.071811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3266ec5e-b6aa-409e-b7a7-848800df9efa tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169547 Jul 11 16:15:31.072413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1584/3239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:31.494962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:31.495851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:31.507078 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:31.507792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:31.509072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:31.509840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:31.517972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:31.596326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:31.596963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:31.603501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:31.603948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:31.604732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:31.605160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:31.657376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:31.665607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-338c7305-ab6d-4b05-a0c4-cc38b9136479 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.177354 Jul 11 16:15:31.666187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1656/3240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:31 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:31.742582 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:31.750825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:31.753009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:31.754184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f02e93c-5593-4b87-b1dc-7d0ea02181c2 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1723 microversion: 2.20 time: 0.162286 Jul 11 16:15:31.754792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1585/3241] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:15:31 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:15:32.090136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:32.090749 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:32.097467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.097923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.098684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.099179 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.239575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:32.248046 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b41aa2f4-3126-44f6-bafa-6a28023a7397 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162112 Jul 11 16:15:32.248867 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1657/3242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:32.546690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-94142982-aa0f-471f-8433-d2d4f57765ff req-bb087b02-92f5-4552-a823-cce950a01da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1c6501-eab9-43c1-bd04-2cd83670e1f6", "name": "network-vif-deleted", "tag": "29f3fd8c-c9d3-4aab-a602-006f32177c7e"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:15:32.555371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-94142982-aa0f-471f-8433-d2d4f57765ff req-bb087b02-92f5-4552-a823-cce950a01da5 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.556011 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-94142982-aa0f-471f-8433-d2d4f57765ff req-bb087b02-92f5-4552-a823-cce950a01da5 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.568223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-94142982-aa0f-471f-8433-d2d4f57765ff req-bb087b02-92f5-4552-a823-cce950a01da5 service nova] Creating event network-vif-deleted:29f3fd8c-c9d3-4aab-a602-006f32177c7e for instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 on hv-cinder-79760 Jul 11 16:15:32.574128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-94142982-aa0f-471f-8433-d2d4f57765ff req-bb087b02-92f5-4552-a823-cce950a01da5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Jul 11 16:15:32.574812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1586/3243] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:15:32.683580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:32.684942 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:32.692238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.692997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.693940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.694539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.773752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:32.774590 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:32.781319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.781835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.782856 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.783525 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.815850 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:32.816427 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:32.816932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lazy-loading 'fault' on Instance uuid ba1c6501-eab9-43c1-bd04-2cd83670e1f6 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:15:32.849772 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:32.858609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f17a0ba3-2f75-4127-8cc7-ffa02457ad39 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.179157 Jul 11 16:15:32.859173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1658/3244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:32 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:32.867002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:32.877340 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:32.878967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '046cf5e98eca41c0a532e84f777efaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5aad4353bf4dc2ba841d971f7212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:32.880137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7854e352-10b9-4197-9eb2-4867c09d74e7 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 200 len: 1371 microversion: 2.20 time: 0.111495 Jul 11 16:15:32.884428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1587/3245] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:15:32 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 16:15:33.265662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:33.266305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:33.272868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.273321 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.274088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.274521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.416498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:33.424721 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-821427a8-9ba5-4235-b196-2df18ac3b954 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162804 Jul 11 16:15:33.425330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1659/3246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:33 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:33.880385 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:33.881528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:33.892632 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.893330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.894189 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.894627 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.899037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:33.899650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:33.906497 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.906946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.907698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:33.908158 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:33.922064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] HTTP exception thrown: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Request method failure captured: Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 HTTP/1.1 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEbzRknGXa67R5M3vb4sZ1a_0eM9QANBoFBoTpXXu7Oa7skFuuBLZLQCzhglPN6QMoVomR1mcE04UcitJBsnSHIyUKHmpAnefwi4R47TDTdXDRbZMyYNg2f48hQDDbmWsNT8pK2801vuCwTwsAFYHyLs-wC1vxKoy35iRxZ8kS5-v7c Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:15:33.923707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e5aad4353bf4dc2ba841d971f7212f2"}]}] Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 046cf5e98eca41c0a532e84f777efaab Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:33.925593 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'ba1c6501-eab9-43c1-bd04-2cd83670e1f6'} Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:15:33.926489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:33.927928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:33.929272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Returning 404 to user: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:15:33.929272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7fd89d2d-f9bd-4b66-82af-13e904fa80f1 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 404 len: 111 microversion: 2.20 time: 0.030137 Jul 11 16:15:33.929272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1660/3247] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:15:33 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:15:33.934307 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b3a24ea3-961c-44c8-bb16-31d0439f3bf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '.version_select at 0x7f20b3ff59d0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:33.954542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b3a24ea3-961c-44c8-bb16-31d0439f3bf3 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262050551" status: 204 len: 0 microversion: 2.20 time: 0.023823 Jul 11 16:15:33.955363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1661/3248] 10.222.0.26 () {60 vars in 1258 bytes} [Mon Jul 11 16:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262050551 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 16:15:34.030081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:34.038628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19e7f0c1-f213-4738-9122-f9ae07a57d09 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165065 Jul 11 16:15:34.039347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1588/3249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:33 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:34.442361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:34.442878 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:34.449193 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.449669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.450431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.450864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.595384 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:34.603542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6c049933-d1dc-4e62-83ce-be404a4bd1b7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165379 Jul 11 16:15:34.604132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1662/3250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:34.864730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:34.865222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:34.871584 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.872030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.872937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.873280 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.887738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] HTTP exception thrown: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Request method failure captured: Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 HTTP/1.1 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEbzRknGXa67R5M3vb4sZ1a_0eM9QANBoFBoTpXXu7Oa7skFuuBLZLQCzhglPN6QMoVomR1mcE04UcitJBsnSHIyUKHmpAnefwi4R47TDTdXDRbZMyYNg2f48hQDDbmWsNT8pK2801vuCwTwsAFYHyLs-wC1vxKoy35iRxZ8kS5-v7c Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:15:34.889535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e5aad4353bf4dc2ba841d971f7212f2"}]}] Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 046cf5e98eca41c0a532e84f777efaab Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.891348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'ba1c6501-eab9-43c1-bd04-2cd83670e1f6'} Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:15:34.892351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.894607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.896197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Returning 404 to user: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:15:34.896197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-512ef4a0-0c4a-4a80-96fa-4469779ded27 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 404 len: 111 microversion: 2.20 time: 0.030580 Jul 11 16:15:34.896197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1589/3251] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 16:15:34 2022] DELETE /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:15:34.899618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:34.900221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: ba1c6501-eab9-43c1-bd04-2cd83670e1f6] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:34.906732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.907180 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.907925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:34.908447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:34.921582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] HTTP exception thrown: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Request method failure captured: Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 HTTP/1.1 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEbzRknGXa67R5M3vb4sZ1a_0eM9QANBoFBoTpXXu7Oa7skFuuBLZLQCzhglPN6QMoVomR1mcE04UcitJBsnSHIyUKHmpAnefwi4R47TDTdXDRbZMyYNg2f48hQDDbmWsNT8pK2801vuCwTwsAFYHyLs-wC1vxKoy35iRxZ8kS5-v7c Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:15:34.923098 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e5aad4353bf4dc2ba841d971f7212f2"}]}] Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 046cf5e98eca41c0a532e84f777efaab Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.924911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'ba1c6501-eab9-43c1-bd04-2cd83670e1f6'} Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:15:34.925893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. Jul 11 16:15:34.927501 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:15:34.929093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Returning 404 to user: Instance ba1c6501-eab9-43c1-bd04-2cd83670e1f6 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:15:34.929093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4d42444e-1a4d-420f-ade0-912cfc5b8f1a tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6" status: 404 len: 111 microversion: 2.20 time: 0.029192 Jul 11 16:15:34.929093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1663/3252] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:15:34 2022] GET /compute/v2.1/servers/ba1c6501-eab9-43c1-bd04-2cd83670e1f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:15:35.060015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:35.061141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:35.071901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:35.072712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:35.073938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:35.074645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:35.220101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:35.228521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-93a2c259-113d-4f59-8234-11f9d343183e tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.174953 Jul 11 16:15:35.229092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1590/3253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:35 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:35.626139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:35.627151 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:35.634136 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:35.634587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:35.635338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:35.635767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:35.786678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:35.795349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7288c0bb-4b2d-4e30-9ec2-20a098193acc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176500 Jul 11 16:15:35.795901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1664/3254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:36.246324 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:36.246917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:36.254160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:36.254586 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:36.255367 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:36.255802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:36.394411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:36.402729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3fa5f779-3a8f-4579-9bf3-70fa11afeb22 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.160410 Jul 11 16:15:36.403345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1591/3255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:36 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:36.818365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:36.819349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:36.830378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:36.831421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:36.832081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:36.832560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:36.979396 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:36.992552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c8217c9f-7a03-470a-a929-3c8e11f6daa6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180358 Jul 11 16:15:36.993418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1665/3256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:37.425206 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:37.425892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:37.433482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:37.433980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:37.434817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:37.435325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:37.569413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:37.577791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24868dad-00ff-4302-9e12-02614b12a4d5 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.159884 Jul 11 16:15:37.578334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1592/3257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:37 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:38.014161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:38.015104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:38.023461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:38.023919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:38.024715 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:38.025150 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:38.171301 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:38.180767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7c4c2454-3412-4c3b-9300-504985a3cc17 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173110 Jul 11 16:15:38.181508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1666/3258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:38.595611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:38.596264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:38.603830 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:38.604281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:38.605068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:38.605497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:38.754565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:38.762928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-061e1938-0b49-4725-9abb-dc3f5dd6e355 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.171295 Jul 11 16:15:38.763508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1593/3259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:38 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:39.199475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:39.200084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:39.209961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:39.210447 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:39.211553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:39.212114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:39.351817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:39.364858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab1053bd-72cb-4f1c-9f23-2f161404a534 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169750 Jul 11 16:15:39.365797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1667/3260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:39.784350 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:39.785358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:39.796628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:39.797430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:39.798675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:39.799404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:39.935305 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:39.943921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca6a5abd-bf89-43a4-9c2e-a2f47e618001 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.166176 Jul 11 16:15:39.944557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1594/3261] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:39 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:40.391129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:40.392090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:40.400325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:40.400801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:40.401548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:40.401979 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:40.547043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:40.556142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7392cfde-a0d1-4dc9-a651-dc6d3b417d6e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171595 Jul 11 16:15:40.556764 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1668/3262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:40.969617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:40.970681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:40.978108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:40.978563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:40.979327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:40.979773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:41.112557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:41.121166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd8565cf-1bc3-45cb-be24-aee10c514cf1 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.158065 Jul 11 16:15:41.121761 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1595/3263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:40 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:41.578358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:41.579290 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:41.590983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:41.591733 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:41.593132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:41.593902 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:41.735699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:41.744230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1666a468-deb8-444e-8d66-52d3c28cdb52 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172621 Jul 11 16:15:41.744890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1669/3264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:41 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:42.142258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:42.143222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:42.154336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:42.155140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:42.156425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:42.157151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:42.291063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:42.299657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-da2b0d04-5549-400c-9724-d148f7dd6b10 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.163925 Jul 11 16:15:42.300223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1596/3265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:42 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:42.761619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:42.762207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:42.769128 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:42.769570 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:42.770387 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:42.770826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:42.906176 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:42.914766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e28757ba-e83b-4ce2-9865-02ffeee86f87 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157213 Jul 11 16:15:42.915343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1670/3266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:42 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:43.321253 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:43.322261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:43.333589 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:43.334036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:43.334800 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:43.335225 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:43.339320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:43.479366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:43.487492 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-03c7c56a-245d-4ce3-ad1e-c8e2855c130d tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173129 Jul 11 16:15:43.488098 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1597/3267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:43 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:43.936465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:43.937424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:43.945928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:43.946373 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:43.947131 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:43.947564 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:44.093087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:44.101507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bf078d30-3dee-4a2c-8393-2aa6beff3ce7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171639 Jul 11 16:15:44.102096 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1671/3268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:44.508123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:44.508935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:44.518027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:44.518620 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:44.519596 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:44.520331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:44.683384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:44.694474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c27d9cd-56b8-470e-b7e5-e71373814c42 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.192686 Jul 11 16:15:44.695062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1598/3269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:44 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:45.123285 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:45.124105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:45.135144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:45.135897 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:45.137241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:45.137940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:45.278860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:45.292546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5bbe31a6-abc3-465b-9c95-f5554b86571a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175820 Jul 11 16:15:45.293450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1672/3270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:45.722316 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:45.723531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:45.734828 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:45.735573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:45.736885 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:45.737631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:45.880259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:45.889024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49d543e6-9a2e-437e-8208-184bde3ccb41 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.173372 Jul 11 16:15:45.889631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1599/3271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:45 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:46.317365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:46.318524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:46.329699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:46.330439 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:46.332063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:46.332934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:46.464686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:46.477619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5f2554c9-e219-43de-bf22-033838e3fc00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166558 Jul 11 16:15:46.478430 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1673/3272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:46 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:46.910208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:46.911472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:46.918449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:46.918889 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:46.919669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:46.920095 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:47.057938 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:47.069931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1d8d0867-709a-4f72-a3ac-f741b2341058 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.165955 Jul 11 16:15:47.070857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1600/3273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:46 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:47.503687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:47.505067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:47.512322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:47.512815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:47.513608 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:47.514067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:47.669565 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:47.682491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6809f41-aa61-4b15-9f14-1576ababba6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185119 Jul 11 16:15:47.683388 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1674/3274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:47 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:48.096120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:48.097151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] [instance: 16771e46-eae0-460a-9353-dbcfdb1338d1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:48.107633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:48.108463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:48.109731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:48.110459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:48.305524 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726afc5bae8a405bb182f9ed67122d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a535e7b6044daa85fa92c799f6069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:48.313550 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e50fc4c1-92a4-4247-8419-710ebbc9ece3 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1" status: 200 len: 1601 microversion: 2.1 time: 0.224195 Jul 11 16:15:48.314117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1601/3275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:48 2022] GET /compute/v2.1/servers/16771e46-eae0-460a-9353-dbcfdb1338d1 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:48.329792 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0edd9b2c-2f21-4167-bb31-37b00f0c6087 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] Calling method '.version_select at 0x7f20bbc328b0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:48.352032 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0edd9b2c-2f21-4167-bb31-37b00f0c6087 tempest-TestMinimumBasicScenario-112363638 tempest-TestMinimumBasicScenario-112363638-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476978995" status: 202 len: 0 microversion: 2.1 time: 0.026037 Jul 11 16:15:48.352521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1675/3276] 10.222.0.26 () {58 vars in 1271 bytes} [Mon Jul 11 16:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476978995 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:15:48.703233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:48.704224 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:48.711966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:48.713945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:48.715695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:48.716365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:48.901554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:48.911698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c61c9cc9-eaad-4246-8285-3985588fa8f7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.214087 Jul 11 16:15:48.913043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1602/3277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:49.930748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:49.931341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:49.933817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:49.940766 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:49.941208 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:49.942354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:49.942890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:49.949340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=100 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:50.137764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-f3798e78-57fc-43a9-b4e0-f140b6b91d6b req-366e8fdf-0d60-42bd-91d6-cda7a10129e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dce4e3-c747-471a-994d-8f005b95f31e", "name": "network-vif-deleted", "tag": "d112ac16-87ca-4a1c-8528-52a0b9fd34bc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:15:50.147710 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f3798e78-57fc-43a9-b4e0-f140b6b91d6b req-366e8fdf-0d60-42bd-91d6-cda7a10129e7 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:50.148359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:50.149268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f3798e78-57fc-43a9-b4e0-f140b6b91d6b req-366e8fdf-0d60-42bd-91d6-cda7a10129e7 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:50.158515 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ba421887-93bb-4239-87d7-e23564d22a31 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.231597 Jul 11 16:15:50.159856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1676/3278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:50.162790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-f3798e78-57fc-43a9-b4e0-f140b6b91d6b req-366e8fdf-0d60-42bd-91d6-cda7a10129e7 service nova] Creating event network-vif-deleted:d112ac16-87ca-4a1c-8528-52a0b9fd34bc for instance 61dce4e3-c747-471a-994d-8f005b95f31e on hv-cinder-79760 Jul 11 16:15:50.168170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-f3798e78-57fc-43a9-b4e0-f140b6b91d6b req-366e8fdf-0d60-42bd-91d6-cda7a10129e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Jul 11 16:15:50.169092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1603/3279] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:15:51.177512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:51.178181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:51.186223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:51.186937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:51.189886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:51.190560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:51.335661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:51.344959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8fc14b9a-dce3-4615-af29-d00b4ad4a4b3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172571 Jul 11 16:15:51.355108 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1677/3280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:51 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:52.367451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:52.368258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:52.375404 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:52.375901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:52.376770 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:52.377246 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:52.516326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:52.524960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-83d679ff-8d5f-49e2-97c2-3ed58b546cc4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164071 Jul 11 16:15:52.525591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1604/3281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:53.543361 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:53.543949 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:53.550932 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:53.551374 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:53.552129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:53.552584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:53.695144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:53.707328 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-09181b78-3068-403e-87f0-f2e57d5d56d8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168039 Jul 11 16:15:53.708873 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1678/3282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:53 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:54.734548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:54.735505 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:54.739318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=58 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:54.744924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:54.745421 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:54.746169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:54.746595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:54.896361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:54.905110 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e893d2d6-87d2-4598-b34c-8dbf0d17771d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.177092 Jul 11 16:15:54.905685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1605/3283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:54 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:55.926491 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:55.928422 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:55.939498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:55.940249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:55.941579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:55.942338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:56.080597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:56.089514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-43517cd3-435a-47da-abcb-6354fb52b394 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169727 Jul 11 16:15:56.090090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1679/3284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:57.111123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:57.112115 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:57.124027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:57.124831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:57.126078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:57.126797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:57.270774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:57.280788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-04124c1d-2bae-4123-b0ce-aa505f8b87f0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176325 Jul 11 16:15:57.281520 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1606/3285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:57 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:58.303997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:58.304849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:58.313926 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:58.314523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:58.315519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:58.316091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:58.457356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:58.466121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e89c84d-0cf9-4c4f-8012-d7913e76d865 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168563 Jul 11 16:15:58.466698 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1680/3286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:58 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:15:59.486388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:15:59.486961 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:15:59.496896 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:59.497344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:59.498105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:15:59.498533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:15:59.640989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:15:59.652614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7e6bd6e-527b-4408-bd12-c2f22f2f8d1f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171768 Jul 11 16:15:59.653526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1607/3287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:15:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:00.676209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:00.677227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:00.684248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:00.684728 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:00.685499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:00.685965 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:00.819312 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:00.832334 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-579c0ab8-d5e0-4791-832a-eb39f5025d71 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162056 Jul 11 16:16:00.833366 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1681/3288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:00 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:01.853242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:01.854044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:01.862912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:01.863482 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:01.864563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:01.865347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:02.003893 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:02.012055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-650a070f-3771-4884-a4c9-bcf615da2f5b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164462 Jul 11 16:16:02.012662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1608/3289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:01 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:03.037401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:03.038462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:03.049672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:03.050408 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:03.051840 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:03.052468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:03.191794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:03.205256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e2c2198-d2e6-4d1b-bd5c-6feca3ee92f2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174170 Jul 11 16:16:03.206587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1682/3290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:03 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:04.224381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:04.224991 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:04.232232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:04.232791 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:04.233536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:04.233963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:04.367532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:04.376245 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2ceb9a66-7e22-4178-9704-d74f604597ec tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156163 Jul 11 16:16:04.376862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1609/3291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:05.401939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:05.402886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:05.413339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:05.413784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:05.414541 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:05.414971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:05.562851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:05.571924 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fda4cd88-95d9-4fb4-ae46-06731400fdca tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176498 Jul 11 16:16:05.572666 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1683/3292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:06.594541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:06.595583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:06.607227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:06.607963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:06.609242 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:06.610004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:06.751381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:06.763628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-73be28f3-7c6c-4d1d-b860-bef6caea57f4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175459 Jul 11 16:16:06.764394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1610/3293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:06 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:07.783851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:07.784542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:07.792737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:07.793310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:07.794144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:07.794657 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:07.967047 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:07.982214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-79ad5519-41fe-456a-81fb-46920509cfa9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.201442 Jul 11 16:16:07.983454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1684/3294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:07 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:09.004756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:09.005845 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:09.017711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:09.018460 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:09.019704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:09.020468 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:09.157532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:09.166273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a13332bf-5276-451b-9028-dd1693420b4a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168085 Jul 11 16:16:09.166831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1611/3295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:10.189015 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:10.189663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:10.197380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:10.197859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:10.198668 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:10.199127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:10.332468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:10.340774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2a3662bc-866a-4289-bff1-25ef584f8f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.156059 Jul 11 16:16:10.341329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1685/3296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:11.361663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:11.362602 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:11.373823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:11.374564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:11.375795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:11.376664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:11.520879 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:11.529244 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e744e512-5d18-4f11-a8da-1062e17d851e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174103 Jul 11 16:16:11.529811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1612/3297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:12.553989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:12.554868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:12.565144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:12.565731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:12.566732 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:12.567304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:12.711511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:12.720194 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-29c45347-430b-4a75-86ad-b9a1804c308a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172777 Jul 11 16:16:12.720843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1686/3298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:12 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:13.741347 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:13.742113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:13.753022 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:13.753704 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:13.754959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:13.755579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:13.758416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=91 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:13.898693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:13.910963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-008971d5-b36e-402f-ae34-b7fe360cbe2e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175814 Jul 11 16:16:13.911728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1613/3299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:14.929041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:14.929650 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:14.937367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:14.937367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:14.937997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:14.938434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:15.076779 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:15.090718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5ad1c1ae-33fe-4460-b24d-1465d8454583 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165288 Jul 11 16:16:15.091479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1687/3300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:16.109857 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:16.110570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:16.118317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:16.119197 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:16.119712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:16.120145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:16.258351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:16.271366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b647f141-e0af-4ade-8b0a-0d2dee4cc4e5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165617 Jul 11 16:16:16.272210 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1614/3301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:16 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:17.294023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:17.295080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:17.306227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:17.307134 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:17.308358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:17.309129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:17.448336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:17.456887 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f88d6bf3-18e0-4eef-b65c-a9ca0f55598f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169816 Jul 11 16:16:17.457432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1688/3302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:17 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:18.481750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:18.482641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:18.493247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:18.493963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:18.494772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:18.495203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:18.648185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:18.657371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e654e6a4-a7ea-47b2-b92b-f4819aa07945 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.182458 Jul 11 16:16:18.657939 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1615/3303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:19.680129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:19.681143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:19.689125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:19.689572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:19.690320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:19.690751 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:19.838913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:19.847904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1c5821ac-ad45-4b99-9a26-5d57c2393c6f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174545 Jul 11 16:16:19.848507 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1689/3304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:19 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:20.867321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:20.868073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:20.876993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:20.877557 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:20.878537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:20.879081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:21.015888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:21.024058 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba851a6f-38b5-4319-826d-adac2d45bfcc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161700 Jul 11 16:16:21.024667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1616/3305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:22.046734 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:22.047711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:22.051682 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=28 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:22.060104 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:22.060583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:22.061345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:22.061783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:22.064542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=83 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:22.194480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:22.203206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3e806cdc-318b-4ae5-9fd1-d2a49fab1c00 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163162 Jul 11 16:16:22.203784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1690/3306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:22 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:23.221622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:23.222236 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:23.229129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:23.229572 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:23.230314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:23.230726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:23.376004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:23.387954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8351ca27-890b-46c4-bc59-93e3c1b8e48f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170055 Jul 11 16:16:23.388816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1617/3307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:24.410123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:24.410711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:24.417706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:24.418225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:24.418997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:24.419434 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:24.555241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:24.563686 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1dfd2f4a-7345-4f73-943c-3a9c4ebc7c46 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157439 Jul 11 16:16:24.564335 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1691/3308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:25.586827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:25.587766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:25.591423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=26 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:25.597418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:25.597861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:25.598636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:25.599061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:25.733408 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:25.741935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-635901d3-a414-45d9-a730-64e62ad9b71b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162122 Jul 11 16:16:25.742480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1618/3309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:25 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:26.763146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:26.764075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:26.775079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:26.775824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:26.777116 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:26.777844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:26.910526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:26.918611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d13718e2-69e2-414e-a4ae-d501021b0615 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162039 Jul 11 16:16:26.919218 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1692/3310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:27.940263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:27.941341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:27.952812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:27.953247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:27.954025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:27.954448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:28.105041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:28.118118 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17e92ac6-404b-4cc7-bd74-01305faccd0a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.184650 Jul 11 16:16:28.119004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1619/3311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:27 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:29.136214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:29.136934 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:29.144202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:29.144688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:29.145462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:29.145899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:29.281508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:29.289695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1e265f81-e96e-4a5f-a14c-a6413173be24 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157743 Jul 11 16:16:29.290273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1693/3312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:30.311722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:30.312698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:30.319983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:30.320470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:30.321229 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:30.321659 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:30.460580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:30.463021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:16:30.464565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:16:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a (ip 10.222.0.26) !!! Jul 11 16:16:30.470757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-35190145-ad68-4452-8005-cdba3fcb56d0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165473 Jul 11 16:16:30.472149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1620/3313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:31.493066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:31.493980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:31.505094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:31.505849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:31.507076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:31.507781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:31.648090 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:31.657238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5fbd5634-0dbc-4309-b426-36be21ce1f27 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170700 Jul 11 16:16:31.657820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1694/3314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:31 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:32.682176 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:32.682838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:32.691304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:32.691753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:32.692532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:32.692966 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:32.836309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:32.845005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a557262c-33b0-4a94-987c-32fe1b094bc8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169241 Jul 11 16:16:32.845612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1621/3315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:33.867489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:33.868467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:33.881127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:33.881957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:33.883247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:33.884002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:34.027349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:34.037370 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80d9ddca-c9e9-4719-b2e0-bc604e428a77 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176485 Jul 11 16:16:34.037946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1695/3316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:33 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:35.063451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:35.064113 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:35.071860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:35.072419 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:35.073240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:35.073729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:35.211049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:35.219413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9e318585-ca81-4345-9f48-cf6368162e78 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162425 Jul 11 16:16:35.220198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1622/3317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:36.241693 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:36.242719 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:36.252618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:36.253068 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:36.253853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:36.254280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:36.384345 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:36.392993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b66150a3-8b8e-4005-9e52-b7f54f083d8b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158238 Jul 11 16:16:36.393579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1696/3318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:36.867918 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:16:36.868175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:16:37.349103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:16:37.350015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:16:37.419610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:37.420716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:37.429091 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:37.429564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:37.430356 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:37.430809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:37.574619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:37.583221 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10a8f79d-8afc-46af-860d-fe461d3d25a7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169894 Jul 11 16:16:37.583785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1623/3319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:37 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:38.600958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:38.601594 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:38.608632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:38.609085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:38.610425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:38.610872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:38.746454 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:38.757141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0016a933-2b7a-4abb-a2c1-b7a274fbf398 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.159757 Jul 11 16:16:38.757904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1697/3320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:38 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:39.784580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:39.785473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:39.796641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:39.797411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:39.798158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:39.798595 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:39.945848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:39.954081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-89b61082-c172-40f4-8361-bc5f45b9b8bc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.176390 Jul 11 16:16:39.954695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1624/3321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:40.982230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:40.983220 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:40.995166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:40.995923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:40.997224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:40.997954 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:41.134703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:41.145620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0266bd16-3103-4152-ae02-3db63b343aac tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.169986 Jul 11 16:16:41.146214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1698/3322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:42.168146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:42.169213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:42.178235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:42.178685 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:42.179719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:42.180150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:42.320234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:42.333143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c6e5d9f3-b9b3-4263-a1b8-9ba38a03fa56 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171283 Jul 11 16:16:42.333917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1625/3323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:42 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:43.359276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:43.360249 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:43.367850 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:43.368318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:43.369088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:43.369519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:43.510431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:43.519100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3041b22c-8bf5-444c-89ce-307a3c7baae4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166388 Jul 11 16:16:43.519694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1699/3324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:44.538973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:44.539824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:44.549407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:44.550326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:44.551331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:44.551903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:44.555773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:44.698258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:44.711923 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba013431-97dc-48e8-9f74-9588b9d6a27a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178366 Jul 11 16:16:44.712732 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1626/3325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:44 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:45.736258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:45.737089 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:45.744242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:45.744737 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:45.745502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:45.745941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:45.888238 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:45.896739 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-67b71e96-2ef1-4f21-9267-5c2c2f586f15 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166793 Jul 11 16:16:45.897324 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1700/3326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:46.919660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:46.920719 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:46.932554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:46.933300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:46.934542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:46.935257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:47.074806 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:47.085374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9b619889-f3b4-4d21-8b4b-44466c5fc0a0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172795 Jul 11 16:16:47.085960 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1627/3327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:46 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:48.108102 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:48.108707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:48.115132 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:48.115578 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:48.116338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:48.116781 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:48.254001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:48.262819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3f85abd5-41db-4dfa-aaf7-c68cfa0d031b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158785 Jul 11 16:16:48.263400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1701/3328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:49.287028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:49.287629 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:49.294096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:49.294547 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:49.295294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:49.295726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:49.441858 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:49.450779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cd761d8e-809e-4277-b9d6-9bb75670ddc7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.170315 Jul 11 16:16:49.451284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1628/3329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:49 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:50.470441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:50.471133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:50.480582 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:50.481149 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:50.482099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:50.482640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:50.611256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:50.620464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-99106b8d-bc64-4833-9ba4-6046eb5e3fee tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.155069 Jul 11 16:16:50.621044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1702/3330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:50 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:51.646954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:51.647903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:51.659235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:51.659946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:51.661382 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:51.661818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:51.818964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:51.827354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a88a1f3d-527b-4a3c-8999-dd6113d3ef21 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.187359 Jul 11 16:16:51.827925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1629/3331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:51 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:52.847958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:52.848886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:52.852379 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=26 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:52.858209 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:52.858656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:52.859419 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:52.859853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:52.862871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=78 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:53.008699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:53.017234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3c4b41a3-a1b6-45f1-9892-2c2e20001641 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175121 Jul 11 16:16:53.017777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1703/3332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:52 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:54.039044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:54.040002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:54.051090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:54.052260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:54.054065 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:54.054758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:54.206398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:54.215318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-25ddc61c-5746-4539-8055-38b14b6c4f4b tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.183302 Jul 11 16:16:54.215888 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1630/3333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:54 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:55.233765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:55.234329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:55.241470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:55.241920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:55.242680 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:55.243118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:55.379254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:55.388062 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-afa82d07-2476-477d-b2b3-2f834c2a45e4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158685 Jul 11 16:16:55.388692 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1704/3334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:55 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:56.410082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:56.411131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:56.414954 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=26 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:16:56.424047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:56.424832 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:56.426111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:56.427008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:56.580009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:56.588903 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d5df1b2-8ac9-47e5-8d57-cc2e71847784 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.185418 Jul 11 16:16:56.589473 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1631/3335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:56 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:57.610492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:57.611441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:57.623197 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:57.623937 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:57.625227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:57.625940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:57.763183 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:57.775579 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-04bac921-ced9-41cc-8694-d9f9f90c9c62 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171366 Jul 11 16:16:57.776431 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1705/3336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:57 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:58.800536 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:58.801426 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:58.808992 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:58.809436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:58.810219 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:58.810646 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:58.947254 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:16:58.956257 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2936c133-8b1a-4874-98e1-c8b1644acf1c tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162032 Jul 11 16:16:58.956874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1632/3337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:58 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:16:59.975901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:16:59.976614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:16:59.985797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:59.986523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:16:59.987819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:16:59.988587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:00.125819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:00.134088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9d05c535-3a7e-478d-b4c1-46daa99e0290 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.163161 Jul 11 16:17:00.134677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1706/3338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:16:59 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:01.155649 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:01.156681 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:01.168364 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:01.169130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:01.170377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:01.171087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:01.315062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:01.323756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-106d214c-d040-4e95-90de-f62271bbea65 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174567 Jul 11 16:17:01.324388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1633/3339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:01 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:02.347780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:02.348759 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:02.360169 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:02.360973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:02.362232 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:02.362958 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:02.512496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:02.521145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fb69c1c4-2fd4-481b-b9ec-bc49c62f5427 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.179836 Jul 11 16:17:02.521724 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1707/3340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:02 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:03.539180 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:03.539811 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:03.546796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:03.547240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:03.547982 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:03.548448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:03.692466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:03.701843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ea98800e-7b09-4485-bad1-aa48558eca54 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167031 Jul 11 16:17:03.702407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1634/3341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:03 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:04.722012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:04.722849 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:04.731952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:04.732602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:04.733605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:04.734184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:04.869837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:04.879856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c9295261-86e8-40cf-b55a-7c3785907cab tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162888 Jul 11 16:17:04.880619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1708/3342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:04 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:05.901943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:05.902531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:05.909360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:05.909773 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:05.910558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:05.911012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:06.063457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:06.072030 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-932f9aa5-f7c3-409a-8a53-3bc2004465a9 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.174252 Jul 11 16:17:06.072644 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1635/3343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:05 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:07.098783 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:07.099844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:07.111086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:07.111841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:07.113117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:07.113843 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:07.248607 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:07.257168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6772450c-f5a2-4500-9edc-822a9bab96a3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164875 Jul 11 16:17:07.257750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1709/3344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:07 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:08.275327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:08.276005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:08.283448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:08.283929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:08.284745 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:08.285182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:08.461008 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:08.475546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-398f1b96-0ee2-4225-8626-2474e3ea9369 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.203783 Jul 11 16:17:08.476663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1636/3345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:08 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:09.497100 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:09.497738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:09.508481 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:09.508940 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:09.509845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:09.510413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:09.660309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:09.668882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-44db8879-2751-4bcc-9546-ae19c157e564 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175786 Jul 11 16:17:09.669468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1710/3346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:09 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:10.691876 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:10.693018 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:10.704262 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:10.705184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:10.706813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:10.707542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:10.846362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:10.856366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9fffe8bc-278d-42dc-a4e7-ff97387a07c5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172407 Jul 11 16:17:10.857009 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1637/3347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:10 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:11.878635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:11.879603 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:11.887799 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:11.888250 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:11.889041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:11.889477 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:12.031000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:12.039207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e8d5d155-6603-4350-962e-83f3a37b6aef tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167138 Jul 11 16:17:12.039812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1711/3348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:11 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:13.059689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:13.060311 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:13.067345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:13.067810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:13.068592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:13.069028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:13.205056 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:13.214049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e29d44fc-6487-4f1f-85ec-2f93f2e7f879 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.159890 Jul 11 16:17:13.214638 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1638/3349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:13 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:14.232359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:14.232996 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:14.239670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:14.240117 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:14.241029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:14.241494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:14.388661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:14.400960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fc9ddaa8-fe99-4ac1-b0e3-5052a401b79e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172702 Jul 11 16:17:14.401722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1712/3350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:14 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:15.421699 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:15.422398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:15.429483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:15.429933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:15.430696 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:15.431150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:15.433713 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:15.567326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:15.578456 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-99a82ebb-2694-4843-bc47-e490290f05bb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.162227 Jul 11 16:17:15.579043 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1639/3351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:15 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:16.600543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:16.601518 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:16.612911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:16.613661 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:16.614916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:16.615652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:16.762508 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:16.775478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b4c8d6bf-2aa3-4acf-9635-425aa9dc0849 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181214 Jul 11 16:17:16.776322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1713/3352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:16 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:17.797079 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:17.797835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:17.805878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:17.806431 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:17.807354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:17.807881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:17.956355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:17.964721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7c68359-c491-4aec-9c85-08d96bbe3ea8 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.173565 Jul 11 16:17:17.965320 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1640/3353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:17 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:18.983907 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:18.984833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:18.995317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:18.996049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:18.997480 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:18.997755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:19.127338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:19.135630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dfa01615-aa41-41c0-aadc-7b30d5aa222f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.157183 Jul 11 16:17:19.136177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1714/3354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:18 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:20.157395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:20.158448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:20.169240 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:20.169689 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:20.170448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:20.170878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:20.307066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:20.315594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7fe40bc8-be79-4531-a65e-1f8524e5f6c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164712 Jul 11 16:17:20.316172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1641/3355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:20 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:21.341152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:21.341750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:21.351200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:21.351625 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:21.352442 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:21.352875 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:21.496615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:21.504952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-662d15d3-ab72-44e9-916a-9f61b9e23abb tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168716 Jul 11 16:17:21.505498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1715/3356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:21 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:22.528200 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:22.529145 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:22.537015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:22.537484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:22.538276 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:22.538730 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:22.684900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:22.693807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-56a05f74-95f5-432f-bfd0-82961add315e tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.172266 Jul 11 16:17:22.694357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1642/3357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:22 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:23.713225 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:23.713971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:23.716826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=26 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:23.724588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:23.725143 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:23.726202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:23.726773 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:23.730716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=78 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:23.861175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:23.869267 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b5d0e746-fb9a-48af-8eac-71060db5c269 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161074 Jul 11 16:17:23.869838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1716/3358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:23 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:24.891192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:24.892077 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:24.903140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:24.903844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:24.905119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:24.905552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:25.046722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:25.055360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3c97349-a345-4272-8e0f-25dce8e3e85a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.171108 Jul 11 16:17:25.055931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1643/3359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:24 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:26.076971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:26.078041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:26.086166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:26.086626 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:26.087526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:26.088043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:26.237276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:26.245580 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2dba0152-1deb-45cc-9345-a5a7395d2ea4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175269 Jul 11 16:17:26.246156 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1717/3360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:26 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:27.266204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:27.266812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:27.269172 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=26 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:27.274931 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:27.275374 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:27.276119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:27.276581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:27.417036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:27.425430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-261cb0f7-1e89-4489-87e5-8c3fadf16bc0 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164868 Jul 11 16:17:27.426003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1644/3361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:27 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:28.447115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:28.448004 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:28.460226 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:28.461035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:28.462284 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:28.463010 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:28.604731 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:28.616037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f341bb2c-659d-47cb-9f33-fb1d7892b171 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.175449 Jul 11 16:17:28.616943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1718/3362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:28 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:29.639840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:29.640564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:29.648672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:29.649198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:29.650090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:29.650609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:29.800648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:29.813742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5825513a-5af3-41c7-b938-1b6eb012167a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180303 Jul 11 16:17:29.814537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1645/3363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:29 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:30.841367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:30.843040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:30.851165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:30.851688 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:30.852605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:30.853110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:31.005002 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:31.016027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-426e0b1b-813e-4149-93fb-69be585dfe48 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.181363 Jul 11 16:17:31.016647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1719/3364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:30 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:32.033096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:32.033706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:32.040655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:32.041106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:32.041864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:32.042298 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:32.174063 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:32.182802 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-acbeecb8-64c2-46aa-ae50-8a25b7e862a2 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.153738 Jul 11 16:17:32.183349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1646/3365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:32 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:33.205217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:33.206405 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:33.217832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:33.218350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:33.219115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:33.219546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:33.369974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:33.379038 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e6ac6b58-109f-4096-8e68-c17165c1aca4 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.180807 Jul 11 16:17:33.379587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1720/3366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:33 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:34.400690 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:34.401645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:34.410412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:34.410861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:34.411613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:34.412045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:34.544795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:34.553609 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f160f20-8727-4a93-8b0f-4d23297f1dd5 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.159416 Jul 11 16:17:34.554178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1647/3367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:34 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:35.575148 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:35.576087 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:35.584039 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:35.584527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:35.585293 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:35.585729 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:35.724637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:35.735972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f95032cb-2ad3-4027-9f75-92f59788eb37 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.167421 Jul 11 16:17:35.736585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1721/3368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:35 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:36.757737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:36.758709 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:36.770103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:36.770839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:36.772075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:36.772837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:36.917508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:36.929987 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a20e6666-be62-4b51-9c96-9f0f7ff0bad3 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.178504 Jul 11 16:17:36.930755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1648/3369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:36 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:37.952960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:37.953620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:37.961923 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:37.962443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:37.963320 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:37.963824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:38.099891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:38.111587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-60779927-ee91-4149-8829-1edd6760952d tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.165600 Jul 11 16:17:38.112161 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1722/3370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:37 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:39.129925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:39.130545 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:39.137605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:39.138044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:39.138794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:39.139215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:39.271315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:39.284327 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb1fad37-4bda-41af-af35-630d303c477a tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158050 Jul 11 16:17:39.285230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1649/3371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:39 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:40.306891 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:40.307908 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:40.319052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:40.319787 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:40.321206 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:40.321919 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:40.458390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:40.466820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66e421b1-ce4f-42d1-a994-04633fe0aeda tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166740 Jul 11 16:17:40.467394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1723/3372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:40 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:41.488170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:41.488975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:41.497459 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:41.498019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:41.498964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:41.499512 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:41.642027 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:41.650583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4c5c856d-ed88-4ae6-ab1c-af3b932e031f tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.168638 Jul 11 16:17:41.651156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1650/3373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:41 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:42.668322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:42.668962 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:42.675982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:42.676468 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:42.677271 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:42.677711 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:42.822125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:42.830896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-9c4da8c5-e183-408c-9b3d-dccd8171f3c6 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166356 Jul 11 16:17:42.831478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1724/3374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:42 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:43.849783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:43.850502 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:43.858401 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:43.858921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:43.859776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:43.860268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:43.993767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:44.007106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4d98483-ffb5-4ad3-827a-234aa30f80fc tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.161770 Jul 11 16:17:44.007912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1651/3375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:43 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:45.033114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:45.034114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:45.041667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:45.042110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:45.042858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:45.043289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:45.183516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:45.193458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-0e98bad4-0023-4819-99bb-1ad31b049e18 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.166854 Jul 11 16:17:45.194057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1725/3376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:45 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:46.214170 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:46.214755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:46.221886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:46.222328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:46.223266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:46.223900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:46.226446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:46.365916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:46.374272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f40c6ee-ec29-4594-9cca-c0e615cc6b61 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.164058 Jul 11 16:17:46.374839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1652/3377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:46 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:47.452877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:47.453496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:47.460563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:47.461016 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:47.461775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:47.462202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:47.621001 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:47.634357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-49ad9d5b-1798-48f3-9f36-8802d1788df7 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.244737 Jul 11 16:17:47.635276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1726/3378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:47 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:48.660107 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:48.661446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] [instance: 88cc8ab2-ba6d-49ba-af09-a265ba22234a] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:48.668323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:48.668796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:48.669552 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:48.669983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:48.803716 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99827ab52d9242f385177cada4335b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b09e1a0de62456d90789370bba74b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:17:48.811746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1732713b-9baa-4ddf-a452-939f2ad07782 tempest-VolumesSnapshotTestJSON-630154212 tempest-VolumesSnapshotTestJSON-630154212-project] 10.222.0.26 "GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a" status: 200 len: 1560 microversion: 2.1 time: 0.158246 Jul 11 16:17:48.812337 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1653/3379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:48 2022] GET /compute/v2.1/servers/88cc8ab2-ba6d-49ba-af09-a265ba22234a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:17:49.467750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:49.469533 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:49.477142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:49.484982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:49.485845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:49.486393 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:49.510630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 HTTP/1.1 Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:17:49.512222 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.514139 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '4b13d806-c073-41ec-8b74-f0dfc037fa88'} Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:17:49.515024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.516648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.518097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:17:49.518097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3bcc79e9-08c8-4c80-acfb-9ea058100b57 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 404 len: 111 microversion: 2.1 time: 0.050063 Jul 11 16:17:49.518097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1727/3380] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:17:49 2022] DELETE /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 16:17:49.523605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:17:49.524218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] [instance: 4b13d806-c073-41ec-8b74-f0dfc037fa88] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:17:49.531161 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:49.531611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:49.532416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:17:49.532848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:17:49.547005 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] HTTP exception thrown: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Request method failure captured: Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 HTTP/1.1 Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEad6jsgJa0DBH82q9cRFo3Ohz0xTh746hli5nC4yjC4w6uiAddVh5wnWuM-cVLd-1bu90KD-Ye0fyPi9mmFhgPbbbNP0VpjGzeLDm9gVeSo46KN2cSWuRaDsj-yD1MH9Pk0F22_Pa045WUiaVvM7Ux5z9W3Qmkn2PcdWjbwCWGkuJY Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:17:49.549323 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6145a3ef3d147afbeb90dd49d01af2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6145a3ef3d147afbeb90dd49d01af2e"}]}] Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f6145a3ef3d147afbeb90dd49d01af2e Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-119508847 Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 052b95d2857c4e728a8008d00fc34780 Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeTestJSON-119508847-project Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.551097 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '4b13d806-c073-41ec-8b74-f0dfc037fa88'} Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:17:49.552155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. Jul 11 16:17:49.554750 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:17:49.556281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] Returning 404 to user: Instance 4b13d806-c073-41ec-8b74-f0dfc037fa88 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:17:49.556281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ec3d371-8974-462b-9cdf-1838f6f994c4 tempest-AttachVolumeTestJSON-119508847 tempest-AttachVolumeTestJSON-119508847-project] 10.222.0.26 "GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88" status: 404 len: 111 microversion: 2.1 time: 0.032322 Jul 11 16:17:49.556281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1654/3381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:17:49 2022] GET /compute/v2.1/servers/4b13d806-c073-41ec-8b74-f0dfc037fa88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:18:30.601540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:18:30.602514 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:18:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:18:31.603980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:18:31.605345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:19:50.478273 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:19:50.479351 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:19:56.877989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:19:56.878853 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:19:57.362425 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:19:57.363310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:21:15.749654 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:21:15.750322 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:21:50.295503 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 16:21:50.296332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=23 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:50.297155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=67 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:50.301227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:21:50.301713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:21:50.309899 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:21:50.310344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:21:50.311159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:21:50.311819 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:21:50.326526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] HTTP exception thrown: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Request method failure captured: Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd HTTP/1.1 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEbzRknGXa67R5M3vb4sZ1a_0eM9QANBoFBoTpXXu7Oa7skFuuBLZLQCzhglPN6QMoVomR1mcE04UcitJBsnSHIyUKHmpAnefwi4R47TDTdXDRbZMyYNg2f48hQDDbmWsNT8pK2801vuCwTwsAFYHyLs-wC1vxKoy35iRxZ8kS5-v7c Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:21:50.328423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e5aad4353bf4dc2ba841d971f7212f2"}]}] Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 046cf5e98eca41c0a532e84f777efaab Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.330586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '4a6ea184-76c8-4450-97c5-b81cbc8aacbd'} Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:21:50.331470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.332999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.335470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Returning 404 to user: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:21:50.336333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4e66609a-912e-497f-b46d-b76a140410fc tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 404 len: 111 microversion: 2.20 time: 0.042866 Jul 11 16:21:50.336880 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1728/3382] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 16:21:50 2022] DELETE /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:21:50.343763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 16:21:50.344362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=21 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:50.345310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=13 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:50.351399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:21:50.351998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] [instance: 4a6ea184-76c8-4450-97c5-b81cbc8aacbd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:21:50.360178 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:21:50.360657 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:21:50.361405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:21:50.361838 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:21:50.377012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] HTTP exception thrown: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Request method failure captured: Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd HTTP/1.1 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEbzRknGXa67R5M3vb4sZ1a_0eM9QANBoFBoTpXXu7Oa7skFuuBLZLQCzhglPN6QMoVomR1mcE04UcitJBsnSHIyUKHmpAnefwi4R47TDTdXDRbZMyYNg2f48hQDDbmWsNT8pK2801vuCwTwsAFYHyLs-wC1vxKoy35iRxZ8kS5-v7c Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:21:50.378749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e5aad4353bf4dc2ba841d971f7212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e5aad4353bf4dc2ba841d971f7212f2"}]}] Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 8e5aad4353bf4dc2ba841d971f7212f2 Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-346063576 Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 046cf5e98eca41c0a532e84f777efaab Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-346063576-project Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.380641 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '4a6ea184-76c8-4450-97c5-b81cbc8aacbd'} Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:21:50.381683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. Jul 11 16:21:50.383354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:21:50.384940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] Returning 404 to user: Instance 4a6ea184-76c8-4450-97c5-b81cbc8aacbd could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:21:50.384940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4a0fca4-5e7c-4d2e-a0a6-30808151de72 tempest-AttachVolumeShelveTestJSON-346063576 tempest-AttachVolumeShelveTestJSON-346063576-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd" status: 404 len: 111 microversion: 2.20 time: 0.038646 Jul 11 16:21:50.384940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1655/3383] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 16:21:50 2022] GET /compute/v2.1/servers/4a6ea184-76c8-4450-97c5-b81cbc8aacbd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 16:21:50.614103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:21:50.614333 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:21:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:21:51.618260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:21:51.619108 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:21:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:21:59.035516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52012. Jul 11 16:21:59.163184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-37db6b7f-7658-4348-8dfb-8d97ccb8727a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: .version_select at 0x7f20bbc48e50>, body: {"keypair": {"name": "tempest-keypair-2090682150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRBqhAv2yBfZN0+0pJQ8b7i7BKdj/lmkLfkBWzAcB+JNT+Vqjz0kMv347Vi76ETugkEekXjVmCdarh2QmmeQLGLQMM5wfDyOetOOiwu1/Nq5D9tII0VRjaXEmxPCjGYg=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:21:59.178821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-37db6b7f-7658-4348-8dfb-8d97ccb8727a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:21:59.183097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-37db6b7f-7658-4348-8dfb-8d97ccb8727a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:21:59.228056 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-37db6b7f-7658-4348-8dfb-8d97ccb8727a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203523 Jul 11 16:21:59.228765 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1729/3384] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 16:21:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:22:00.563169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-994413073", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cc437c9-1a96-402b-8921-f2dfeb0418e7"}], "security_groups": [{"name": "tempest-securitygroup--1098809094"}], "key_name": "tempest-keypair-2090682150", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:22:00.570387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:00.571060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:00.587740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52026. Jul 11 16:22:00.801143 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] validate_networks() for [('2cc437c9-1a96-402b-8921-f2dfeb0418e7', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:22:01.241322 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:22:01.241844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:22:01.242413 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:22:01.242950 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:22:01.243553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:22:01.253187 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:01.253807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:01.255012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:01.255215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:01.272758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:22:01.276739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:22:01.289776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:22:01.292215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:22:01.344999 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-523ce0a6-b6d6-495b-9844-c27a108246cb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786212 Jul 11 16:22:01.352564 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1656/3385] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:22:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 16:22:01.356049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-137a0e9a-d276-47af-805e-e3b01791d455 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:01.356974 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-137a0e9a-d276-47af-805e-e3b01791d455 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:01.359652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:01.502124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-137a0e9a-d276-47af-805e-e3b01791d455 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:01.509065 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-137a0e9a-d276-47af-805e-e3b01791d455 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1241 microversion: 2.1 time: 0.157082 Jul 11 16:22:01.509911 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1730/3386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:01 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:02.529313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:02.530783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:02.540204 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:02.541306 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:02.542631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:02.543390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:02.620169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:02.629521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d9c98ed-8c8e-4854-ba5f-5de438ab8412 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1301 microversion: 2.1 time: 0.106470 Jul 11 16:22:02.630599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1657/3387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:02 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:03.647234 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:03.647852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:03.655756 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:03.656210 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:03.657014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:03.657453 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:03.802547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:03.812086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-80365bb5-652d-493c-9327-ecb19a5c5618 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.168682 Jul 11 16:22:03.813475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1731/3388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:03 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:03.982366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-c19c00ba-d3c0-4324-a413-8740f6de7f8d req-fee10ac9-5eed-445a-a803-a571d75e3dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad5f24-8d02-49f3-8d92-cd0c875e937b", "tag": "e2b2708b-83d7-4b2f-bebd-7039661074aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:22:03.995558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c19c00ba-d3c0-4324-a413-8740f6de7f8d req-fee10ac9-5eed-445a-a803-a571d75e3dba service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:03.996034 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c19c00ba-d3c0-4324-a413-8740f6de7f8d req-fee10ac9-5eed-445a-a803-a571d75e3dba service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:04.013593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-c19c00ba-d3c0-4324-a413-8740f6de7f8d req-fee10ac9-5eed-445a-a803-a571d75e3dba service nova] Creating event network-changed:e2b2708b-83d7-4b2f-bebd-7039661074aa for instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b on hv-cinder-79760 Jul 11 16:22:04.020591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-c19c00ba-d3c0-4324-a413-8740f6de7f8d req-fee10ac9-5eed-445a-a803-a571d75e3dba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107386 Jul 11 16:22:04.021198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1658/3389] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:22:04.833985 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:04.835137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:04.844020 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:04.844504 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:04.845266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:04.845700 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:04.980663 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:04.992037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8b2ee908-e09d-4fca-9cec-7e09d796a835 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.164781 Jul 11 16:22:04.992882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1732/3390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:04 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:06.012753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:06.013445 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:06.020507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:06.027796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:06.027796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:06.027796 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:06.157631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:06.169188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9635ca8-3472-458f-ac3f-ca2429d91a04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.162578 Jul 11 16:22:06.169765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1659/3391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:06 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:07.190572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:07.191037 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:07.198460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:07.198905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:07.199807 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:07.200241 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:07.331402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:07.339186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-92387347-cb6a-4ce5-9692-d58ca3f7fb75 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.155846 Jul 11 16:22:07.339805 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1733/3392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:07 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:08.359190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:08.359848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:08.367795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:08.368402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:08.369318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:08.369824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:08.506400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:08.515882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-feb658b8-93d0-4f39-a13c-cfb27a3d192c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.161934 Jul 11 16:22:08.516483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1660/3393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:08 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:09.407540 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-661f9b8b-08b6-4da0-b2f7-146aaa2b7a11 req-3b88a53c-7bc1-4d09-a639-720259a5fe64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad5f24-8d02-49f3-8d92-cd0c875e937b", "name": "network-vif-plugged", "status": "completed", "tag": "e2b2708b-83d7-4b2f-bebd-7039661074aa"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:22:09.415986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-661f9b8b-08b6-4da0-b2f7-146aaa2b7a11 req-3b88a53c-7bc1-4d09-a639-720259a5fe64 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:09.416458 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-661f9b8b-08b6-4da0-b2f7-146aaa2b7a11 req-3b88a53c-7bc1-4d09-a639-720259a5fe64 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:09.427233 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-661f9b8b-08b6-4da0-b2f7-146aaa2b7a11 req-3b88a53c-7bc1-4d09-a639-720259a5fe64 service nova] Creating event network-vif-plugged:e2b2708b-83d7-4b2f-bebd-7039661074aa for instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b on hv-cinder-79760 Jul 11 16:22:09.433587 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-661f9b8b-08b6-4da0-b2f7-146aaa2b7a11 req-3b88a53c-7bc1-4d09-a639-720259a5fe64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087987 Jul 11 16:22:09.434251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1734/3394] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:22:09.533711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:09.534344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:09.541307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:09.541757 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:09.542521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:09.543457 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:09.679448 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:09.687764 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-022aaef1-4b2b-483c-adcc-f8047632abc9 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.158032 Jul 11 16:22:09.688637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1661/3395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:09 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:10.715040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:10.716363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:10.726855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:10.727589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:10.728881 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:10.729595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:10.877360 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:10.889558 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6a7f9bc-1621-4455-bf7e-10d2d875a28e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1367 microversion: 2.1 time: 0.181829 Jul 11 16:22:10.890436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1735/3396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:10 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:22:11.906785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:11.907738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:11.914070 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:11.914677 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:11.922959 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:11.923398 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:11.924150 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:11.924605 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:12.095508 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:22:12.104023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c1f49c6-80ab-4cde-bd11-77d88cfb41cd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1556 microversion: 2.1 time: 0.198672 Jul 11 16:22:12.112918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1662/3397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:22:11 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:22:12.129400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:12.131080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:12.134266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:12.141397 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:12.141901 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:12.142660 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:12.143086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:12.223529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-31dc61fd-dee0-42ac-87df-6ee255654f8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098182 Jul 11 16:22:12.224133 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1736/3398] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 16:22:12 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:22:13.413238 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-19810055-b460-4175-b431-47c347627720 req-20c27c14-9ab5-4629-8d40-f02fde48aa56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ad5f24-8d02-49f3-8d92-cd0c875e937b", "tag": "e2b2708b-83d7-4b2f-bebd-7039661074aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:22:13.422501 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-19810055-b460-4175-b431-47c347627720 req-20c27c14-9ab5-4629-8d40-f02fde48aa56 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:13.422934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-19810055-b460-4175-b431-47c347627720 req-20c27c14-9ab5-4629-8d40-f02fde48aa56 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:13.434338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-19810055-b460-4175-b431-47c347627720 req-20c27c14-9ab5-4629-8d40-f02fde48aa56 service nova] Creating event network-changed:e2b2708b-83d7-4b2f-bebd-7039661074aa for instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b on hv-cinder-79760 Jul 11 16:22:13.440275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-19810055-b460-4175-b431-47c347627720 req-20c27c14-9ab5-4629-8d40-f02fde48aa56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030887 Jul 11 16:22:13.440978 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1663/3399] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:22:47.252069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:47.253177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=30 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:47.258436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:22:47.259024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:22:47.267817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:47.268240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:47.269145 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:22:47.269665 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:22:47.304152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-62bbc267-abec-4d73-a01e-327dd702ddce tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b/ips" status: 200 len: 149 microversion: 2.1 time: 0.053672 Jul 11 16:22:47.304794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1737/3400] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 16:22:47 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:23:10.491530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:23:10.491530 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:23:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:23:16.891459 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:23:16.892516 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:23:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:23:47.378218 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:47.380123 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=36 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:47.387268 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:47.388213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:47.400255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:47.401042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:47.402277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:47.402989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:47.430292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:23:47.517647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-370eabbd-349f-442b-b8f5-d8d660d2798d tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 204 len: 0 microversion: 2.1 time: 0.142620 Jul 11 16:23:47.518124 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1664/3401] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:23:47 2022] DELETE /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:23:47.524573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:47.525522 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=4 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:47.530412 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:47.531023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:47.538040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:47.538489 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:47.539251 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:47.539684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:47.675049 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:47.686648 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6386e2d1-5561-4d7e-b0f4-0884b62baa2a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1681 microversion: 2.1 time: 0.163735 Jul 11 16:23:47.687642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1738/3402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:47 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:48.710099 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:48.711252 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:48.720259 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:48.720739 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:48.721496 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:48.721936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:48.867183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:48.875192 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e01cb1bb-c0e4-4e0b-b47b-36e5f838064c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1681 microversion: 2.1 time: 0.172644 Jul 11 16:23:48.875762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1665/3403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:48 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:49.733631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7939c308-6041-4ad4-9ab0-688d96da1d50 req-6be3369f-5121-4c0b-87d0-d0b084ae12dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ad5f24-8d02-49f3-8d92-cd0c875e937b", "name": "network-vif-deleted", "tag": "e2b2708b-83d7-4b2f-bebd-7039661074aa"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:23:49.743274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7939c308-6041-4ad4-9ab0-688d96da1d50 req-6be3369f-5121-4c0b-87d0-d0b084ae12dd service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:49.743689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7939c308-6041-4ad4-9ab0-688d96da1d50 req-6be3369f-5121-4c0b-87d0-d0b084ae12dd service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:49.755571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7939c308-6041-4ad4-9ab0-688d96da1d50 req-6be3369f-5121-4c0b-87d0-d0b084ae12dd service nova] Creating event network-vif-deleted:e2b2708b-83d7-4b2f-bebd-7039661074aa for instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b on hv-cinder-79760 Jul 11 16:23:49.761512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7939c308-6041-4ad4-9ab0-688d96da1d50 req-6be3369f-5121-4c0b-87d0-d0b084ae12dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031910 Jul 11 16:23:49.762127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1739/3404] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:23:49.892913 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:49.893555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:49.900711 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:49.901388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:49.902249 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:49.902778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:49.938965 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:49.939511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:49.940041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lazy-loading 'fault' on Instance uuid c3ad5f24-8d02-49f3-8d92-cd0c875e937b {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:23:49.981998 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:49.990294 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cebda5ac-2727-406a-92a1-d3c034636e94 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 200 len: 1331 microversion: 2.1 time: 0.101650 Jul 11 16:23:49.990877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1666/3405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:49 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:51.012633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:51.013517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:51.024105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:51.024955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:51.026195 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:51.026914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:51.042110 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b HTTP/1.1 Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:23:51.043785 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:23:51.046855 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'c3ad5f24-8d02-49f3-8d92-cd0c875e937b'} Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:23:51.048029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:23:51.049835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:23:51.051359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:23:51.051359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-845b5975-64a0-41a8-844b-b8c50444b5ad tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 404 len: 111 microversion: 2.1 time: 0.040583 Jul 11 16:23:51.051359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1740/3406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:51 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:23:51.054601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b65e2d63-f739-490e-8d81-56875886e2b6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '.version_select at 0x7f20b3251670>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:51.078062 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b65e2d63-f739-490e-8d81-56875886e2b6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090682150" status: 202 len: 0 microversion: 2.1 time: 0.027325 Jul 11 16:23:51.078626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1667/3407] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 16:23:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090682150 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:23:51.990273 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a8486ec-65e7-455f-9abb-1528ac66c0d3 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: .version_select at 0x7f20b336c1f0>, body: {"keypair": {"name": "tempest-keypair-1863125819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeXYDRvl5wo9r5giW48vzkSc5vPEezU54UwWPaopWS7hKkrclIZvgqVxeQ5behxYSegb9FyXbbd15zd5HJVsT3Q0F0KCaLxYVgGdIamED4HlHLPyGDevA5yme5h1sX8yw=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:23:52.006029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7a8486ec-65e7-455f-9abb-1528ac66c0d3 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:23:52.010610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-7a8486ec-65e7-455f-9abb-1528ac66c0d3 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:23:52.036966 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a8486ec-65e7-455f-9abb-1528ac66c0d3 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050728 Jul 11 16:23:52.038575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1741/3408] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 16:23:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:23:53.359066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1687791260", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cc437c9-1a96-402b-8921-f2dfeb0418e7"}], "security_groups": [{"name": "tempest-securitygroup--589926437"}], "key_name": "tempest-keypair-1863125819", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:23:53.467286 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] validate_networks() for [('2cc437c9-1a96-402b-8921-f2dfeb0418e7', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:23:53.843498 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:23:53.843922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:23:53.844428 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:23:53.844849 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:23:53.845265 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:23:53.854371 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:53.854814 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:53.855594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:53.856028 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:53.873795 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:23:53.877841 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:23:53.889579 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:23:53.891829 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:23:53.952213 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43f8022e-a7a3-48cc-9768-aeffcbf23fb4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.597547 Jul 11 16:23:53.952933 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1668/3409] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:23:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 16:23:53.963687 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8c28d82b-2114-490a-bd58-e9475b6ae74f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:53.964305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8c28d82b-2114-490a-bd58-e9475b6ae74f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:54.019670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8c28d82b-2114-490a-bd58-e9475b6ae74f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:54.026499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8c28d82b-2114-490a-bd58-e9475b6ae74f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1242 microversion: 2.1 time: 0.066923 Jul 11 16:23:54.027076 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1742/3410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:53 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:55.044357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:55.045120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:55.051854 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:55.052334 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:55.053155 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:55.053594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:55.122855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:55.133026 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0719d9f2-e735-40eb-83ad-ac1598e64d20 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1300 microversion: 2.1 time: 0.093580 Jul 11 16:23:55.134050 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1669/3411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:55 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:56.151695 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:56.153166 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:56.160217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:56.160708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:56.161462 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:56.161904 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:56.317986 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:56.325676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-22b099dc-3e5a-4c2a-8d4e-2bd355f9cdf6 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.177845 Jul 11 16:23:56.326450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1743/3412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:56 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:56.366778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-3de6aae3-c535-455f-9a07-23d751a91208 req-78a2f6bd-5826-4f8d-921b-96201c7093d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2819789c-2c74-4edb-89a1-db71c6f4a936", "tag": "d2cbab02-1345-4906-bc16-e2b51cbcbc97"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:23:56.376486 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3de6aae3-c535-455f-9a07-23d751a91208 req-78a2f6bd-5826-4f8d-921b-96201c7093d1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:56.376929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3de6aae3-c535-455f-9a07-23d751a91208 req-78a2f6bd-5826-4f8d-921b-96201c7093d1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:56.389317 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-3de6aae3-c535-455f-9a07-23d751a91208 req-78a2f6bd-5826-4f8d-921b-96201c7093d1 service nova] Creating event network-changed:d2cbab02-1345-4906-bc16-e2b51cbcbc97 for instance 2819789c-2c74-4edb-89a1-db71c6f4a936 on hv-cinder-79760 Jul 11 16:23:56.395315 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-3de6aae3-c535-455f-9a07-23d751a91208 req-78a2f6bd-5826-4f8d-921b-96201c7093d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032250 Jul 11 16:23:56.396133 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1670/3413] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:23:57.346629 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:57.347323 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:57.357882 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:57.358517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:57.359707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:57.360141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:57.528121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:57.538827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8d55d73f-49d9-47a9-a287-79b7e0407720 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.198167 Jul 11 16:23:57.539427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1744/3414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:57 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:58.563002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:58.564424 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:58.571381 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:58.572092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:58.573166 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:58.573763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:58.714328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:58.722695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-34d59d4e-b072-43f9-8a95-fd74e3b6721b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.166753 Jul 11 16:23:58.723233 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1671/3415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:58 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:23:59.743970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:23:59.744656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:23:59.755806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:59.756466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:59.757697 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:23:59.758305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:23:59.914359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:23:59.923050 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91833a0d-a28b-4140-b53a-e0f44df9c66a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.186264 Jul 11 16:23:59.923640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1745/3416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:23:59 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:24:00.944330 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:24:00.945359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:24:00.957023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:00.957823 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:00.959092 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:00.959804 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:01.093001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:24:01.100930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2ba58493-159f-4033-929d-5555e9f82f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.163249 Jul 11 16:24:01.101499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1672/3417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:24:00 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:24:02.012842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-e30c5dff-ea36-4bb1-b347-831cc24e8025 req-6690cb2e-fe61-40ad-9d3a-e8ad2d959b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2819789c-2c74-4edb-89a1-db71c6f4a936", "name": "network-vif-plugged", "status": "completed", "tag": "d2cbab02-1345-4906-bc16-e2b51cbcbc97"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:24:02.021762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e30c5dff-ea36-4bb1-b347-831cc24e8025 req-6690cb2e-fe61-40ad-9d3a-e8ad2d959b3e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:02.022082 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e30c5dff-ea36-4bb1-b347-831cc24e8025 req-6690cb2e-fe61-40ad-9d3a-e8ad2d959b3e service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:02.035944 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-e30c5dff-ea36-4bb1-b347-831cc24e8025 req-6690cb2e-fe61-40ad-9d3a-e8ad2d959b3e service nova] Creating event network-vif-plugged:d2cbab02-1345-4906-bc16-e2b51cbcbc97 for instance 2819789c-2c74-4edb-89a1-db71c6f4a936 on hv-cinder-79760 Jul 11 16:24:02.040983 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-e30c5dff-ea36-4bb1-b347-831cc24e8025 req-6690cb2e-fe61-40ad-9d3a-e8ad2d959b3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031849 Jul 11 16:24:02.041750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1746/3418] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:24:02.118402 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:24:02.119042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:24:02.126533 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:02.126986 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:02.127753 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:02.128182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:02.265993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:24:02.273475 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66dcea39-0638-4b87-9b05-8d05f8176a8b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1367 microversion: 2.1 time: 0.158991 Jul 11 16:24:02.274044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1673/3419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:24:02 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:24:03.291392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:24:03.292177 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:24:03.300804 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:03.301254 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:03.302012 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:03.302441 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:03.434377 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:24:03.443051 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e0eff92d-254f-40f5-a8f0-76c7bd032d13 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1556 microversion: 2.1 time: 0.156382 Jul 11 16:24:03.443571 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1747/3420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:24:03 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:24:03.463647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:24:03.464190 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:24:03.471226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:03.471672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:03.472521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:03.472948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:03.554335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-659bb16e-5221-4d0d-9d94-a32081dafebb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094470 Jul 11 16:24:03.554940 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1674/3421] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 16:24:03 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:24:04.845640 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=6 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:04.914646 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-a581b2af-b7f9-49e0-abdc-588f3e1366df req-7bb454b5-5c99-42ad-b1a8-a848ef9034b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2819789c-2c74-4edb-89a1-db71c6f4a936", "tag": "d2cbab02-1345-4906-bc16-e2b51cbcbc97"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:24:04.923552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-a581b2af-b7f9-49e0-abdc-588f3e1366df req-7bb454b5-5c99-42ad-b1a8-a848ef9034b1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:04.923993 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-a581b2af-b7f9-49e0-abdc-588f3e1366df req-7bb454b5-5c99-42ad-b1a8-a848ef9034b1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:04.935146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-a581b2af-b7f9-49e0-abdc-588f3e1366df req-7bb454b5-5c99-42ad-b1a8-a848ef9034b1 service nova] Creating event network-changed:d2cbab02-1345-4906-bc16-e2b51cbcbc97 for instance 2819789c-2c74-4edb-89a1-db71c6f4a936 on hv-cinder-79760 Jul 11 16:24:04.940597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-a581b2af-b7f9-49e0-abdc-588f3e1366df req-7bb454b5-5c99-42ad-b1a8-a848ef9034b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099370 Jul 11 16:24:04.941196 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1748/3422] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:24:41.147182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:41.148002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:41.149472 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:41.150151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:41.154805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:24:41.155283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:24:41.165465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:41.165935 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:41.166686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:24:41.167117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:24:41.192915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a08603d5-94f5-42cd-b1f2-7ea5e4cb9f3c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936/ips" status: 200 len: 149 microversion: 2.1 time: 0.047283 Jul 11 16:24:41.193860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1675/3423] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 16:24:41 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:41.263532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:41.264349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=38 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:41.268925 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:41.269707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:41.278917 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:41.279359 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:41.280115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:41.280588 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:41.308560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:25:41.393350 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-71f8e816-83de-420b-bf2c-4322b11cc1cf tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 204 len: 0 microversion: 2.1 time: 0.131415 Jul 11 16:25:41.394118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1749/3424] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:25:41 2022] DELETE /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:25:41.400836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:41.401565 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:41.406032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:41.406636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:41.413555 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:41.413997 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:41.414729 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:41.415151 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:41.557929 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:41.569529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f72b0fc2-892c-4e76-bde3-549381fc7808 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1681 microversion: 2.1 time: 0.170331 Jul 11 16:25:41.570292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1676/3425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:41 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:42.598511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:42.599496 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:42.607864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:42.608311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:42.609154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:42.609583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:42.749029 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:42.756637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4f7c0ff3-c707-4a89-ba25-b25866929230 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1681 microversion: 2.1 time: 0.165176 Jul 11 16:25:42.757223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1750/3426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:42 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:43.775388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:43.776877 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:43.789774 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:43.790630 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:43.791613 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:43.792237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:43.865861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:43.875255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c926f0c-09e3-454a-b275-71367cf30c37 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 200 len: 1614 microversion: 2.1 time: 0.104159 Jul 11 16:25:43.882415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1677/3427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:43 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:43.890928 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-9e910071-35bf-4336-826f-513447f9a915 req-a5d40274-1570-41a8-91fa-9a36b558118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2819789c-2c74-4edb-89a1-db71c6f4a936", "name": "network-vif-deleted", "tag": "d2cbab02-1345-4906-bc16-e2b51cbcbc97"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:43.900443 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9e910071-35bf-4336-826f-513447f9a915 req-a5d40274-1570-41a8-91fa-9a36b558118b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:43.900884 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-9e910071-35bf-4336-826f-513447f9a915 req-a5d40274-1570-41a8-91fa-9a36b558118b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:43.912788 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-9e910071-35bf-4336-826f-513447f9a915 req-a5d40274-1570-41a8-91fa-9a36b558118b service nova] Creating event network-vif-deleted:d2cbab02-1345-4906-bc16-e2b51cbcbc97 for instance 2819789c-2c74-4edb-89a1-db71c6f4a936 on hv-cinder-79760 Jul 11 16:25:43.919229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-9e910071-35bf-4336-826f-513447f9a915 req-a5d40274-1570-41a8-91fa-9a36b558118b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Jul 11 16:25:43.920095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1751/3428] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:44.895878 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:44.896925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:44.907973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:44.908765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:44.909994 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:44.910725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:44.926786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 HTTP/1.1 Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:25:44.928528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:25:44.930526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '2819789c-2c74-4edb-89a1-db71c6f4a936'} Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:25:44.931917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:25:44.933724 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:44.935414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:25:44.935414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e058a0dc-a011-404f-952c-c72864fda579 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 404 len: 111 microversion: 2.1 time: 0.040653 Jul 11 16:25:44.935414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1678/3429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:44 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:25:44.940451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a05108e-7026-4dd2-ba1a-3348458f3888 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '.version_select at 0x7f20b31a5e50>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:44.961676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a05108e-7026-4dd2-ba1a-3348458f3888 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863125819" status: 202 len: 0 microversion: 2.1 time: 0.025743 Jul 11 16:25:44.962332 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1752/3430] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 16:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863125819 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:25:45.606593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-883ee1f5-73d3-471d-b75a-2156c34b6ac0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: .version_select at 0x7f20b32518b0>, body: {"keypair": {"name": "tempest-keypair-231230033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0v6lvN4sj4S6RmyUtBsSvxW/QuYzPBU0qAZXKpZ5fIGRm72+2/1ClZpqu1IZmqvAqzpuIXCYTrWUfC8+GRGuzE+PPHuqFPA+BiPRG1TM0JqOsCfa8uS01br8gMX6cSZg=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:45.621299 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-883ee1f5-73d3-471d-b75a-2156c34b6ac0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:25:45.625344 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-883ee1f5-73d3-471d-b75a-2156c34b6ac0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:25:45.652263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-883ee1f5-73d3-471d-b75a-2156c34b6ac0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050233 Jul 11 16:25:45.652882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1679/3431] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 16:25:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:25:46.950420 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1198992543", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cc437c9-1a96-402b-8921-f2dfeb0418e7"}], "security_groups": [{"name": "tempest-securitygroup--1667713978"}], "key_name": "tempest-keypair-231230033", "user_data": "}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:47.061637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] validate_networks() for [('2cc437c9-1a96-402b-8921-f2dfeb0418e7', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:25:47.623284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:47.624389 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:47.625115 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:25:47.625704 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:25:47.626824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:25:47.627389 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:25:47.627888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:25:47.636256 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.637029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.642826 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.643712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.658995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.659906 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.661972 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.663245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.686015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:25:47.703343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:25:47.728305 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Getting quotas for user ad1057ac8f4c471bb9ffdb8a8f1fe61c and project f8ad959b0413410ab06c7ff793b7801b. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:25:47.764385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:25:47.770528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:25:47.813787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-554f3cb8-ff38-4cda-9e20-d192cb506946 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 204 len: 0 microversion: 2.1 time: 0.194618 Jul 11 16:25:47.814793 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1680/3432] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:25:47 2022] DELETE /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:25:47.830338 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:47.831807 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:47.838876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e9d182c-8bbb-4f0a-b9a7-2b03eafaacf5 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.893285 Jul 11 16:25:47.846283 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1753/3433] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:25:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 16:25:47.851339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3dc1bada-79e1-455a-b548-667be2cae35c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:47.851939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3dc1bada-79e1-455a-b548-667be2cae35c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:47.861688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.865379 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.867790 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:47.868232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:47.925137 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3dc1bada-79e1-455a-b548-667be2cae35c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:47.933111 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3dc1bada-79e1-455a-b548-667be2cae35c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1241 microversion: 2.1 time: 0.085679 Jul 11 16:25:47.943536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1754/3434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:47 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:48.096029 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:48.108234 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1fc6872c-4911-4741-9a89-9b9dcab5eda6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1507 microversion: 2.1 time: 0.286707 Jul 11 16:25:48.110357 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1681/3435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:47 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:48.950340 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:48.950971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:48.958545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:48.958988 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:48.959760 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:48.960227 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:49.022973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:49.030784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-fcfef7ff-1dc2-4484-99c1-3c7e39edfce1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1245 microversion: 2.1 time: 0.084506 Jul 11 16:25:49.031549 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1755/3436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:48 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:49.126740 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:49.127342 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:49.134037 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:49.134778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:49.135279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:49.135707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:49.271819 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:49.279900 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-688f4196-bec8-40d2-8a7f-cab62717c186 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1507 microversion: 2.1 time: 0.157054 Jul 11 16:25:49.280662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1682/3437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:49 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:50.047893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:50.048738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:50.056070 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:50.056639 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:50.057421 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:50.057854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:50.120142 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:50.127545 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-390b804d-a940-467c-9a83-727be276d999 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1245 microversion: 2.1 time: 0.083682 Jul 11 16:25:50.128118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1756/3438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:50 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:50.297731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:50.298476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:50.304946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:50.305390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:50.306348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:50.307024 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:50.451973 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:50.459758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-79ac6d16-a213-4574-8e9d-f0fb1deafa84 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1507 microversion: 2.1 time: 0.166163 Jul 11 16:25:50.460405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1683/3439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:50 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:51.145061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:51.146556 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:51.155093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:51.157309 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:51.158364 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:51.159512 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:51.270168 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:51.278027 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7a8c6151-30f1-4fc6-966e-94cfa323eee1 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1237 microversion: 2.1 time: 0.136994 Jul 11 16:25:51.279025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1757/3440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:51 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1237 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:25:51.478307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:51.479021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:51.485848 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:51.486303 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:51.487073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:51.487497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:51.600916 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-813145f9-cdcb-4f5d-9821-b82275b6841b req-7bfa13f9-8286-4aad-a945-8545fcec4b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9253b43a-7bea-41c3-9e1a-3e37e78d533b", "name": "network-vif-deleted", "tag": "569881a6-8f34-4c5f-8e43-71e7594c6f67"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:51.615385 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-813145f9-cdcb-4f5d-9821-b82275b6841b req-7bfa13f9-8286-4aad-a945-8545fcec4b6c service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:51.616527 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-813145f9-cdcb-4f5d-9821-b82275b6841b req-7bfa13f9-8286-4aad-a945-8545fcec4b6c service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:51.629365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-813145f9-cdcb-4f5d-9821-b82275b6841b req-7bfa13f9-8286-4aad-a945-8545fcec4b6c service nova] Creating event network-vif-deleted:569881a6-8f34-4c5f-8e43-71e7594c6f67 for instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b on hv-cinder-79760 Jul 11 16:25:51.635121 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-813145f9-cdcb-4f5d-9821-b82275b6841b req-7bfa13f9-8286-4aad-a945-8545fcec4b6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043556 Jul 11 16:25:51.636014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1758/3441] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:51.645183 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:51.657880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-34e8ce3b-452f-427d-abf7-e64f7eea1d2f tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1465 microversion: 2.1 time: 0.184096 Jul 11 16:25:51.659078 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1684/3442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:51 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:52.160708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-fb3e90a5-bde5-4506-a51e-c485eed97562 req-e9dc1a4a-0441-4945-9a5d-2af54600213d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16771e46-eae0-460a-9353-dbcfdb1338d1", "name": "network-vif-deleted", "tag": "1dde6cf4-4caa-44b8-937b-986dee3f0852"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:52.170659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fb3e90a5-bde5-4506-a51e-c485eed97562 req-e9dc1a4a-0441-4945-9a5d-2af54600213d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.171107 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-fb3e90a5-bde5-4506-a51e-c485eed97562 req-e9dc1a4a-0441-4945-9a5d-2af54600213d service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.182298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-fb3e90a5-bde5-4506-a51e-c485eed97562 req-e9dc1a4a-0441-4945-9a5d-2af54600213d service nova] Creating event network-vif-deleted:1dde6cf4-4caa-44b8-937b-986dee3f0852 for instance 16771e46-eae0-460a-9353-dbcfdb1338d1 on hv-cinder-79760 Jul 11 16:25:52.191677 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-fb3e90a5-bde5-4506-a51e-c485eed97562 req-e9dc1a4a-0441-4945-9a5d-2af54600213d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036869 Jul 11 16:25:52.192812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1759/3443] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:52.295863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:52.297087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:52.304979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.305675 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.306808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.307540 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.385906 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:52.395325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4169683e-5e53-444e-928c-dbb49c63e433 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1299 microversion: 2.1 time: 0.103769 Jul 11 16:25:52.396558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1685/3444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:52 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:52.676973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:52.677694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:52.687752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.692483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.693998 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.694863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.780052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:52.781299 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:52.782155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lazy-loading 'fault' on Instance uuid 9253b43a-7bea-41c3-9e1a-3e37e78d533b {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:25:52.842821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:52.849950 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ca2e2228-642e-47be-8db5-f42c4cee6436 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 200 len: 1311 microversion: 2.1 time: 0.177330 Jul 11 16:25:52.850748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1760/3445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:52 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:53.412580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:53.413469 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:53.421963 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.422989 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.423924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.424451 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.629715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:53.639839 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-571480cd-1442-4dbf-a4c9-84fa50215f62 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.231203 Jul 11 16:25:53.641116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1686/3446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:53 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:53.795519 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-96187bc7-3fcf-4d17-8986-c0146625085e req-eaa66830-b31b-4a83-827d-c7f264e8a463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb", "tag": "0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:53.813162 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-96187bc7-3fcf-4d17-8986-c0146625085e req-eaa66830-b31b-4a83-827d-c7f264e8a463 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.813610 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-96187bc7-3fcf-4d17-8986-c0146625085e req-eaa66830-b31b-4a83-827d-c7f264e8a463 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.828052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-96187bc7-3fcf-4d17-8986-c0146625085e req-eaa66830-b31b-4a83-827d-c7f264e8a463 service nova] Creating event network-changed:0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a for instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb on hv-cinder-79760 Jul 11 16:25:53.833551 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-96187bc7-3fcf-4d17-8986-c0146625085e req-eaa66830-b31b-4a83-827d-c7f264e8a463 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041632 Jul 11 16:25:53.834172 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1761/3447] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:53.869742 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:53.870354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 9253b43a-7bea-41c3-9e1a-3e37e78d533b] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:53.877277 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.877816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.878712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.879158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.901844 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] HTTP exception thrown: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Request method failure captured: Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b HTTP/1.1 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizEag6YXw0V8Ns2rYUS4MeF5L8t83JnP0MsleHCR6D95kVRhHreNBQ2_BQpw0h4naIrMpOyCFpfi_eQSoa-7F1SIzfTJCnYoWWQNuLVUtmHrA0vmzox_gC7uTtHMhfqz1gN3OnXgB2LoeW5lb8Pd6sH3wDFSV1uAVfGMQhz8vVWt-eDo Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:25:53.903622 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c230554e8a34a7086e433e797360e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c230554e8a34a7086e433e797360e28"}]}] Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 9d44f1f434534cc0b373943d48d672df Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. Jul 11 16:25:53.905759 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '9253b43a-7bea-41c3-9e1a-3e37e78d533b'} Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:25:53.907558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. Jul 11 16:25:53.910493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:25:53.915663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Returning 404 to user: Instance 9253b43a-7bea-41c3-9e1a-3e37e78d533b could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:25:53.917129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0daab2df-f54f-48f0-a185-b825345192ca tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b" status: 404 len: 111 microversion: 2.1 time: 0.052423 Jul 11 16:25:53.918353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1687/3448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:53 2022] GET /compute/v2.1/servers/9253b43a-7bea-41c3-9e1a-3e37e78d533b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:25:53.928127 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:53.928753 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:53.937793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.938314 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.939355 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:53.939858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:53.968694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:25:54.052943 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6e3764f-a3f2-4f53-ae39-fcd4f1d7884e tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 204 len: 0 microversion: 2.1 time: 0.129427 Jul 11 16:25:54.053854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1762/3449] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:25:53 2022] DELETE /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:25:54.064013 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:54.064645 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:54.070686 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:54.071126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:54.072726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:54.073261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:54.210572 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-c6f74f6a-2de0-428e-96a5-e3eacf5008bd req-4f2e19db-d9f8-4d24-82a1-5267d96c9a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cc8ab2-ba6d-49ba-af09-a265ba22234a", "name": "network-vif-deleted", "tag": "88d23ed5-4317-4cea-94b2-c4f3cbaf4e65"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:54.215341 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:54.219413 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c6f74f6a-2de0-428e-96a5-e3eacf5008bd req-4f2e19db-d9f8-4d24-82a1-5267d96c9a28 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:54.219862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c6f74f6a-2de0-428e-96a5-e3eacf5008bd req-4f2e19db-d9f8-4d24-82a1-5267d96c9a28 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:54.223746 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc6942a2-a69b-4617-a813-a936348537bc tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.165220 Jul 11 16:25:54.224452 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1688/3450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:54 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:54.232380 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-c6f74f6a-2de0-428e-96a5-e3eacf5008bd req-4f2e19db-d9f8-4d24-82a1-5267d96c9a28 service nova] Creating event network-vif-deleted:88d23ed5-4317-4cea-94b2-c4f3cbaf4e65 for instance 88cc8ab2-ba6d-49ba-af09-a265ba22234a on hv-cinder-79760 Jul 11 16:25:54.237567 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-c6f74f6a-2de0-428e-96a5-e3eacf5008bd req-4f2e19db-d9f8-4d24-82a1-5267d96c9a28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Jul 11 16:25:54.238378 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1763/3451] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:54.657059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:54.657634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:54.664808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:54.665400 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:54.666061 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:54.666493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:54.808975 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:54.817216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0201666f-fbfd-4736-a79d-5ad47dc424f8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.163842 Jul 11 16:25:54.817862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1689/3452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:54 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:55.241637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:55.242298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:55.249367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:55.250093 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:55.251040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:55.251752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:55.502991 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d44f1f434534cc0b373943d48d672df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c230554e8a34a7086e433e797360e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:55.512418 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c0539e40-e459-4ef2-9539-74308d13b518 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 200 len: 1522 microversion: 2.1 time: 0.275140 Jul 11 16:25:55.512945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1764/3453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:55 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:55.836326 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:55.838019 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:55.840102 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:55.847712 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:55.848169 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:55.849082 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:55.849853 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:55.855327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-75774411-98be-44cd-b49c-1151c88e5d4f req-5e65a6f5-6164-44d6-8090-a2c4059c6b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2901472e-529a-4ef6-a35e-0677479d2964", "name": "network-vif-deleted", "tag": "248914ee-b4de-4e63-aafa-d5668dd61063"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:25:55.865542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-75774411-98be-44cd-b49c-1151c88e5d4f req-5e65a6f5-6164-44d6-8090-a2c4059c6b1a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:55.866000 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-75774411-98be-44cd-b49c-1151c88e5d4f req-5e65a6f5-6164-44d6-8090-a2c4059c6b1a service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:55.878189 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-75774411-98be-44cd-b49c-1151c88e5d4f req-5e65a6f5-6164-44d6-8090-a2c4059c6b1a service nova] Creating event network-vif-deleted:248914ee-b4de-4e63-aafa-d5668dd61063 for instance 2901472e-529a-4ef6-a35e-0677479d2964 on hv-cinder-79760 Jul 11 16:25:55.883317 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-75774411-98be-44cd-b49c-1151c88e5d4f req-5e65a6f5-6164-44d6-8090-a2c4059c6b1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 Jul 11 16:25:55.886699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1765/3454] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:25:56.020970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:56.030388 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c9d11a5-d21b-4bdf-a1c1-1bd0a608d87c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.198191 Jul 11 16:25:56.036513 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1690/3455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:55 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:56.531310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:56.532114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] [instance: 2901472e-529a-4ef6-a35e-0677479d2964] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:56.538643 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:56.540247 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:56.541003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:56.541451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:56.555479 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] HTTP exception thrown: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Request method failure captured: Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 HTTP/1.1 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizEag6YXw0V8Ns2rYUS4MeF5L8t83JnP0MsleHCR6D95kVRhHreNBQ2_BQpw0h4naIrMpOyCFpfi_eQSoa-7F1SIzfTJCnYoWWQNuLVUtmHrA0vmzox_gC7uTtHMhfqz1gN3OnXgB2LoeW5lb8Pd6sH3wDFSV1uAVfGMQhz8vVWt-eDo Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:25:56.557272 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c230554e8a34a7086e433e797360e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c230554e8a34a7086e433e797360e28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c230554e8a34a7086e433e797360e28"}]}] Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: 5c230554e8a34a7086e433e797360e28 Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-684339933 Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: 9d44f1f434534cc0b373943d48d672df Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-684339933-project Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. Jul 11 16:25:56.559066 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '2901472e-529a-4ef6-a35e-0677479d2964'} Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:25:56.560064 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. Jul 11 16:25:56.561775 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:25:56.563295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] Returning 404 to user: Instance 2901472e-529a-4ef6-a35e-0677479d2964 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:25:56.563295 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-230830b8-ad8c-4907-81ef-dee8a4397ce6 tempest-ServerRescueNegativeTestJSON-684339933 tempest-ServerRescueNegativeTestJSON-684339933-project] 10.222.0.26 "GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964" status: 404 len: 111 microversion: 2.1 time: 0.032264 Jul 11 16:25:56.563862 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1766/3456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:56 2022] GET /compute/v2.1/servers/2901472e-529a-4ef6-a35e-0677479d2964 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 16:25:57.048497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:57.049336 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:57.057165 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:57.057614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:57.058737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:57.059167 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:57.199126 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:57.207263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc32f3da-633a-49d5-ab70-175e1408e4bd tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.162939 Jul 11 16:25:57.207824 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1691/3457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:57 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:58.224094 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:58.225030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:58.229889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:58.230960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=8 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:58.235400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:58.235852 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:58.236667 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:58.237105 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:58.431358 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:58.439597 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7d0bcb0c-80b0-4799-a0b3-38f4b71b7511 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.219335 Jul 11 16:25:58.440185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1767/3458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:58 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:25:59.456843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:25:59.458284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:25:59.469296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:59.470816 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:59.471765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:25:59.472702 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:25:59.648474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:25:59.660055 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1d2fcd88-d954-4499-bae4-2c1aa36ea475 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.206474 Jul 11 16:25:59.661736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1692/3459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:25:59 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:00.680888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:00.682072 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:00.692938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:00.693656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:00.695074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:00.700651 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:00.860642 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:00.869414 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-f09e7b07-36bb-4d11-b929-d3c29b22cf4a tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.192740 Jul 11 16:26:00.870085 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1768/3460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:00 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:01.387559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-cc700c6d-8d70-4691-be9e-f3dafbf97538 req-c70ed747-e83d-4693-a8fd-6215ef16873b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb", "name": "network-vif-plugged", "status": "completed", "tag": "0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:26:01.399528 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-cc700c6d-8d70-4691-be9e-f3dafbf97538 req-c70ed747-e83d-4693-a8fd-6215ef16873b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:01.400281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-cc700c6d-8d70-4691-be9e-f3dafbf97538 req-c70ed747-e83d-4693-a8fd-6215ef16873b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:01.411345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:01.422546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-cc700c6d-8d70-4691-be9e-f3dafbf97538 req-c70ed747-e83d-4693-a8fd-6215ef16873b service nova] Creating event network-vif-plugged:0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a for instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb on hv-cinder-79760 Jul 11 16:26:01.429313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-cc700c6d-8d70-4691-be9e-f3dafbf97538 req-c70ed747-e83d-4693-a8fd-6215ef16873b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047160 Jul 11 16:26:01.430434 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1693/3461] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:26:01.887365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:01.889424 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:01.898689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:01.899513 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:01.901138 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:01.901743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:01.906929 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:02.061357 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:02.071159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1f378b08-78c5-4fa7-b863-33f42fc24ef4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1367 microversion: 2.1 time: 0.188278 Jul 11 16:26:02.072185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1769/3462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:01 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:03.089577 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:03.090328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:03.098674 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:03.099131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:03.100447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:03.100447 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:03.291186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:03.299669 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7455192-7bbc-4727-8d5b-b9b7196a411b tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1556 microversion: 2.1 time: 0.214814 Jul 11 16:26:03.300707 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1694/3463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:03 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:03.316618 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:03.317758 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:03.327854 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:03.328401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:03.329534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:03.330035 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:03.414842 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-cac73029-a84a-47c1-81cc-3246f82510fb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102233 Jul 11 16:26:03.415617 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1770/3464] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 16:26:03 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:26:04.461283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-96f8d10c-4787-410d-9b06-c0b49898e9ea req-d4a6b526-01f4-4692-9513-3f51b848a5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb", "tag": "0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:26:04.471680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-96f8d10c-4787-410d-9b06-c0b49898e9ea req-d4a6b526-01f4-4692-9513-3f51b848a5de service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:04.472387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-96f8d10c-4787-410d-9b06-c0b49898e9ea req-d4a6b526-01f4-4692-9513-3f51b848a5de service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:04.485855 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-96f8d10c-4787-410d-9b06-c0b49898e9ea req-d4a6b526-01f4-4692-9513-3f51b848a5de service nova] Creating event network-changed:0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a for instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb on hv-cinder-79760 Jul 11 16:26:04.493096 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-96f8d10c-4787-410d-9b06-c0b49898e9ea req-d4a6b526-01f4-4692-9513-3f51b848a5de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036442 Jul 11 16:26:04.501970 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1695/3465] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:26:27.198826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:27.199606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=8 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:27.403048 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ab781932-0aa1-47f7-9dfb-3fd88aa0469e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Action: 'create', calling method: .version_select at 0x7f20bbc48ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1595576547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjVa46KTfngalUHJJRIAMTFh5+vWCGc/1x9km9DSzaweSfFqpBSd8nwHcfHKoh6yXpOx21Vw2Z+eZdm2yyXSTs0iFvpyqrBFjrziOnmL7CvARcyayXFMZLpf5eD19NMSA=="}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:26:27.420415 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ab781932-0aa1-47f7-9dfb-3fd88aa0469e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Getting quotas for project 15f80256e12d4678ac08717e16368e64. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:26:27.424394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-ab781932-0aa1-47f7-9dfb-3fd88aa0469e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Getting quotas for user 46b01ee6b70b4da38f9735df5ecc0d1c and project 15f80256e12d4678ac08717e16368e64. Resources: {'key_pairs'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:26:27.448620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ab781932-0aa1-47f7-9dfb-3fd88aa0469e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.255569 Jul 11 16:26:27.449159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1771/3466] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 16:26:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:26:37.380164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:26:37.380752 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:26:48.412205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:48.413186 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=8 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:48.419116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:48.419875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:48.431177 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:48.431749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:48.432619 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:48.433047 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:48.457672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-81e56838-9585-47e7-9524-6779617a3dfb tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/ips" status: 200 len: 149 microversion: 2.1 time: 0.047653 Jul 11 16:26:48.458153 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1696/3467] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 16:26:48 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:26:49.789835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=4 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:49.790606 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:49.795656 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43186ce6-0a0d-4ebd-8dc1-ab7c628342a0"}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:26:49.796784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:49.806794 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:49.807532 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:49.808634 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:49.809129 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:50.073801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-7beb84f5-6ca0-4b9e-8dfb-b0a05b980476 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "POST /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285148 Jul 11 16:26:50.074457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1772/3468] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 16:26:49 2022] POST /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:26:57.683836 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-308947834", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1595576547", "security_groups": [{"name": "tempest-secgroup-smoke-474072238"}], "networks": [{"uuid": "e6b86869-5250-4082-93f0-d08698af634a"}], "block_device_mapping_v2": [{"uuid": "50ba793b-ae36-4a71-8794-aefc98370177", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:26:57.827006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] validate_networks() for [('e6b86869-5250-4082-93f0-d08698af634a', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:26:57.901372 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:57.901961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:57.910028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:57.910673 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:57.911449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:57.912055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:58.002237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lazy-loading 'services' on Instance uuid edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:26:58.117106 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5f6c3163-2ddf-40ea-bed8-d3356df5ffc8 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments/43186ce6-0a0d-4ebd-8dc1-ab7c628342a0" status: 202 len: 0 microversion: 2.1 time: 0.219891 Jul 11 16:26:58.117714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1773/3469] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 16:26:57 2022] DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments/43186ce6-0a0d-4ebd-8dc1-ab7c628342a0 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:26:58.137124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:58.139024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:58.151521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:58.152637 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:58.153824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:58.154786 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:58.215857 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3649191d-6c5e-4691-84f4-faeb893d190e tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091388 Jul 11 16:26:58.217130 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1774/3470] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:26:58 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:26:58.451181 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:58.533822 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:26:58.534661 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:26:58.535142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:26:58.535548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:26:58.536141 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:26:58.545648 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:58.546146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:58.547198 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:58.547634 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:58.566647 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Getting quotas for project 15f80256e12d4678ac08717e16368e64. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:26:58.579131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Getting quotas for user 46b01ee6b70b4da38f9735df5ecc0d1c and project 15f80256e12d4678ac08717e16368e64. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:26:58.639768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:26:58.641892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50ba793b-ae36-4a71-8794-aefc98370177',volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:26:58.778549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-71400acc-2fe2-4321-b63a-810fc58ac8b8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.099369 Jul 11 16:26:58.790655 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2633219a-5113-4343-b735-1697e53c4197 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:58.791455 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2633219a-5113-4343-b735-1697e53c4197 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:58.795875 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1697/3471] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:26:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 16:26:58.873465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2633219a-5113-4343-b735-1697e53c4197 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:58.883376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2633219a-5113-4343-b735-1697e53c4197 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1088 microversion: 2.1 time: 0.096586 Jul 11 16:26:58.884112 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1775/3472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:58 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:59.483164 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:59.484610 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:59.491511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.492284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.493907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.494594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.525728 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4de52451-edda-4898-b257-e6236678a3db tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.301288 Jul 11 16:26:59.526281 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1698/3473] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 16:26:59 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb/os-volume_attachments => generated 25 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 16:26:59.590207 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:59.590691 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:59.598165 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.598611 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.599354 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.599752 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.625526 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:26:59.710376 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-1b1caad9-05c5-4edd-b912-840e4e7f5183 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 204 len: 0 microversion: 2.1 time: 0.123581 Jul 11 16:26:59.711893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1776/3474] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:26:59 2022] DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:26:59.720897 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:59.721436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:59.728922 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.729587 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.730348 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.730825 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.881025 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:59.889021 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8f51a0ae-1c41-4369-9205-5ad30dd3a266 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1681 microversion: 2.1 time: 0.172370 Jul 11 16:26:59.889593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1699/3475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:59 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:26:59.905187 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:26:59.905889 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:26:59.912457 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.912914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.913757 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:26:59.914242 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:26:59.978720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:26:59.986548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-91e98c41-45af-447f-842f-c31713e8969a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1194 microversion: 2.1 time: 0.085601 Jul 11 16:26:59.987120 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1777/3476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:26:59 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:00.907087 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:00.907820 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:00.914894 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:00.915593 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:00.916384 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:00.916871 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:01.005482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:01.006524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:01.014400 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:01.015077 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:01.016073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:01.016672 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:01.177467 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:01.193081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c620b5e6-eed0-4879-bdc4-f5086373ffb3 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1194 microversion: 2.1 time: 0.192257 Jul 11 16:27:01.203782 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1778/3477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:00 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1194 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:01.246926 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:01.254529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-706efdcd-8363-43f2-8e39-d6e60ef8d3bc tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1681 microversion: 2.1 time: 0.351676 Jul 11 16:27:01.255199 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1700/3478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:00 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:02.212239 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:02.212893 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:02.219684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:02.220200 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:02.221060 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:02.221560 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:02.271031 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:02.271766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:02.279208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:02.279652 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:02.280466 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:02.280901 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:02.298097 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:02.307190 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-83f7c5cc-5b3e-4647-9017-e8c107d70055 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1194 microversion: 2.1 time: 0.099970 Jul 11 16:27:02.307784 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1779/3479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:02 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:02.446731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:02.457529 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45d6b6ae-3e90-45a3-9e31-02bf32796d04 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1681 microversion: 2.1 time: 0.190307 Jul 11 16:27:02.458414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1701/3480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:02 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:03.328034 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:03.329627 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:03.338722 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:03.339184 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:03.340052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:03.340528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:03.412231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:03.419868 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-672fbb5b-a000-4657-8e8f-cffbf5325d79 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1194 microversion: 2.1 time: 0.098481 Jul 11 16:27:03.420463 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1780/3481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:03 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:03.478399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:03.478911 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:03.486048 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:03.486506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:03.487261 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:03.487693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:03.627548 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:03.635788 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4b221c0-7162-43b5-871d-698fd5e7b10f tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1681 microversion: 2.1 time: 0.163371 Jul 11 16:27:03.636409 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1702/3482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:03 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:04.437464 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:04.438982 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:04.447971 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:04.448743 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:04.449777 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:04.450484 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:04.561099 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:04.573494 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-b0aac72a-a21b-4d0b-8847-b79077fbf3af tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1204 microversion: 2.1 time: 0.139358 Jul 11 16:27:04.574600 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1781/3483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:04 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1204 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:04.654212 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:04.655546 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:04.666860 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:04.667318 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:04.668116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:04.671470 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:04.771817 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ad959b0413410ab06c7ff793b7801b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:04.791147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c0aa6b9-e599-4622-a09f-f16e586963d4 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 200 len: 1613 microversion: 2.1 time: 0.130784 Jul 11 16:27:04.791805 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1703/3484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:04 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 1613 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:05.034164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1471730764", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "networks": [{"uuid": "db107b29-13df-448e-bcc4-ee1840057a9e"}]}} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:05.119939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.network.neutron [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] validate_networks() for [('db107b29-13df-448e-bcc4-ee1840057a9e', None, None, None, None, None)] {{(pid=124242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:27:05.357032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-f9ace9ae-cc93-4c2e-b556-7903463a6e0b req-59b7aa76-fe53-413c-aa76-a2567b9d5a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb", "name": "network-vif-deleted", "tag": "0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:05.372003 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f9ace9ae-cc93-4c2e-b556-7903463a6e0b req-59b7aa76-fe53-413c-aa76-a2567b9d5a34 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.372766 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f9ace9ae-cc93-4c2e-b556-7903463a6e0b req-59b7aa76-fe53-413c-aa76-a2567b9d5a34 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.387972 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-f9ace9ae-cc93-4c2e-b556-7903463a6e0b req-59b7aa76-fe53-413c-aa76-a2567b9d5a34 service nova] Creating event network-vif-deleted:0d133d5a-39f7-4090-b9cf-b94cc2b2aa7a for instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb on hv-cinder-79760 Jul 11 16:27:05.393617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-f9ace9ae-cc93-4c2e-b556-7903463a6e0b req-59b7aa76-fe53-413c-aa76-a2567b9d5a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266165 Jul 11 16:27:05.394705 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1704/3485] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:27:05.595223 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:05.596570 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:05.611792 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.616785 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.618354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.619292 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.859741 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Flavor limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:27:05.860826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Image limits 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:27:05.861363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Flavor pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:27:05.861838 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Image pref 0:0:0 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:27:05.862298 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.virt.hardware [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:27:05.872995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.873542 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.874465 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.874970 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.903815 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Getting quotas for project ce9d90202a824e3689fc7a2538407fd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:27:05.911040 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.quota [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Getting quotas for user b701c953ae4f485ba6cefed3178f9951 and project ce9d90202a824e3689fc7a2538407fd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:27:05.924946 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Going to run 1 instances... {{(pid=124242) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:27:05.927506 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:27:05.935558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:05.945185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b1550cb3-ee62-44d2-a715-3f218bcb1348 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.355140 Jul 11 16:27:05.946517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1705/3486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:05 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:05.951778 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:05.952827 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:05.961786 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.962532 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.963535 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:05.964149 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:05.984556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb HTTP/1.1 Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:27:05.986912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:05.987980 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb'} Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:05.988591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:05.989500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:05.994581 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:05.995700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29262b98-47fa-4755-88e5-b60999e35104 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 404 len: 111 microversion: 2.1 time: 0.048007 Jul 11 16:27:05.996945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1706/3487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:05 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:06.006559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-4a21b695-33b5-4aad-85dc-df63d5b55ac0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976281 Jul 11 16:27:06.009275 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-34128ef5-3876-4576-8d40-cc5c2bfddbb0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '.version_select at 0x7f20b3264af0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:06.009392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1782/3488] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 16:27:06.019831 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3a9e7349-6f70-4bd9-8d9e-db254038e498 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:06.021703 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3a9e7349-6f70-4bd9-8d9e-db254038e498 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:06.065007 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-34128ef5-3876-4576-8d40-cc5c2bfddbb0 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231230033" status: 202 len: 0 microversion: 2.1 time: 0.063501 Jul 11 16:27:06.066736 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1707/3489] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 11 16:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231230033 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:27:06.083918 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-582ea323-8db6-431c-8df1-c6f7b3665e55 req-0f76a732-6dbb-4232-9864-437006fab1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:06.121296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-582ea323-8db6-431c-8df1-c6f7b3665e55 req-0f76a732-6dbb-4232-9864-437006fab1be service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:06.121743 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-582ea323-8db6-431c-8df1-c6f7b3665e55 req-0f76a732-6dbb-4232-9864-437006fab1be service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:06.145812 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-582ea323-8db6-431c-8df1-c6f7b3665e55 req-0f76a732-6dbb-4232-9864-437006fab1be service nova] Creating event network-changed:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:27:06.162851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-582ea323-8db6-431c-8df1-c6f7b3665e55 req-0f76a732-6dbb-4232-9864-437006fab1be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084553 Jul 11 16:27:06.165377 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1708/3490] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:27:06.220030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3a9e7349-6f70-4bd9-8d9e-db254038e498 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:06.229821 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3a9e7349-6f70-4bd9-8d9e-db254038e498 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1214 microversion: 2.1 time: 0.213537 Jul 11 16:27:06.240941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1783/3491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:06 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:06.964004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:06.964626 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:06.971310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:06.971747 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:06.972907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:06.973339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:07.220608 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:07.229559 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb6fbe34-ae5a-48cb-8973-9a44668e0527 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.270393 Jul 11 16:27:07.230365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1709/3492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:06 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:07.249826 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:07.250433 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:07.433268 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:07.433716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:07.434482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:07.434960 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:07.534913 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:07.546014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-66e4c8d5-f45b-4e3f-b850-032028fc1204 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1266 microversion: 2.1 time: 0.302502 Jul 11 16:27:07.547279 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1784/3493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:07 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:08.111902 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.113085 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.120032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.120725 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.121612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.122203 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.137664 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb HTTP/1.1 Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:27:08.139601 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.140779 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb'} Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.141346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.142331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.144184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.145068 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7930164d-caa3-4f43-ba0f-974949be4424 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 404 len: 111 microversion: 2.1 time: 0.037428 Jul 11 16:27:08.145636 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1710/3494] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:27:08 2022] DELETE /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:08.154394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.155146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.162135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.162659 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.163559 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.164342 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.179801 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb HTTP/1.1 Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:08.181517 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.182632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb'} Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.183229 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. Jul 11 16:27:08.184147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.185042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.185042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2eacd0e3-0cb2-4a6a-a4a1-73e702e448ca tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb" status: 404 len: 111 microversion: 2.1 time: 0.032705 Jul 11 16:27:08.185042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1785/3495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:08 2022] GET /compute/v2.1/servers/edc3e687-5e9a-4fcf-8b5e-25bd99aa01eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:08.194041 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.195360 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.207423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.207964 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.208915 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.209422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.224937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 HTTP/1.1 Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:27:08.226808 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.228119 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': '2819789c-2c74-4edb-89a1-db71c6f4a936'} Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.228851 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.229840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.231810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.232899 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4e2d567-d008-4559-bc37-46a49a7ce2d2 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 404 len: 111 microversion: 2.1 time: 0.042817 Jul 11 16:27:08.233936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1711/3496] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:27:08 2022] DELETE /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:08.241869 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.242780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: 2819789c-2c74-4edb-89a1-db71c6f4a936] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.249891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.255152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.255679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.256449 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.257026 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.257741 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.267561 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.268369 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.269663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.270284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.271961 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 HTTP/1.1 Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:08.273812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.274856 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '2819789c-2c74-4edb-89a1-db71c6f4a936'} Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.275460 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. Jul 11 16:27:08.276423 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.277230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance 2819789c-2c74-4edb-89a1-db71c6f4a936 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.277230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a1bbed03-0c02-4a9a-a450-75bad605ac21 tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936" status: 404 len: 111 microversion: 2.1 time: 0.037475 Jul 11 16:27:08.277230 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1786/3497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:08 2022] GET /compute/v2.1/servers/2819789c-2c74-4edb-89a1-db71c6f4a936 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 16:27:08.291795 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.303851 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.310557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.311043 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.311823 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.312258 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.336499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: DELETE /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b HTTP/1.1 Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:08.338113 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.339175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'c3ad5f24-8d02-49f3-8d92-cd0c875e937b'} Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.339744 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.341266 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.342511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.342511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-787543e6-278c-40cd-9942-e776f1e0a6ee tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 404 len: 111 microversion: 2.1 time: 0.052025 Jul 11 16:27:08.342511 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1787/3498] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:27:08 2022] DELETE /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:08.348425 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.349198 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] [instance: c3ad5f24-8d02-49f3-8d92-cd0c875e937b] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.356073 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.356905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.357892 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.358555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.379045 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] HTTP exception thrown: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Request method failure captured: Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b HTTP/1.1 Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE4m4Vnq9DIqzvKgstOqAceoCltIv2KFc28XcwdMwZ78SCcz0yGkamum3Bs_MF49ZIn5aZsh7bRbkqGS4VgF-U_LgiisMzAv8yF6tHZq6OKaLNrC5jJ4HaSOtitpFqGxhVD3TvexJ6RQh-i2O4E3f-CAZlwqv5r_4sANSilpCneCE2Q Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:08.380676 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ad959b0413410ab06c7ff793b7801b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ad959b0413410ab06c7ff793b7801b"}]}] Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: f8ad959b0413410ab06c7ff793b7801b Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-919787801 Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: ad1057ac8f4c471bb9ffdb8a8f1fe61c Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-AttachVolumeNegativeTest-919787801-project Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.381767 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': 'c3ad5f24-8d02-49f3-8d92-cd0c875e937b'} Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:08.382440 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. Jul 11 16:27:08.383417 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:08.385081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] Returning 404 to user: Instance c3ad5f24-8d02-49f3-8d92-cd0c875e937b could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:08.385081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6677f7f5-ced2-4239-89a4-88e43b44494c tempest-AttachVolumeNegativeTest-919787801 tempest-AttachVolumeNegativeTest-919787801-project] 10.222.0.26 "GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b" status: 404 len: 111 microversion: 2.1 time: 0.037731 Jul 11 16:27:08.385081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1788/3499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:08 2022] GET /compute/v2.1/servers/c3ad5f24-8d02-49f3-8d92-cd0c875e937b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:08.470333 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:08.480769 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5eb3adb-737b-447e-80e1-74b8cc1cc8a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.234143 Jul 11 16:27:08.481556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1712/3500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:08 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:08.564437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:08.565052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:08.577619 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.578652 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.579436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:08.579876 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:08.999531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-149b7142-c118-44f7-9622-580605d91a9b req-a3fcc570-babe-4ba8-ac69-63dff8f24ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd5478e-f531-4d9f-b1e0-93f12811bc13", "tag": "fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:09.004936 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:09.005654 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:09.011948 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-149b7142-c118-44f7-9622-580605d91a9b req-a3fcc570-babe-4ba8-ac69-63dff8f24ae0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:09.012698 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-149b7142-c118-44f7-9622-580605d91a9b req-a3fcc570-babe-4ba8-ac69-63dff8f24ae0 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:09.024563 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-149b7142-c118-44f7-9622-580605d91a9b req-a3fcc570-babe-4ba8-ac69-63dff8f24ae0 service nova] Creating event network-changed:fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23 for instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 on hv-cinder-79760 Jul 11 16:27:09.029480 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-149b7142-c118-44f7-9622-580605d91a9b req-a3fcc570-babe-4ba8-ac69-63dff8f24ae0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Jul 11 16:27:09.030162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1713/3501] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 16:27:09.119236 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:09.126910 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-286fe48e-3526-41ca-9069-40079a96affb tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.566912 Jul 11 16:27:09.127492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1789/3502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:08 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:09.499287 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:09.500156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:09.506721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:09.507500 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:09.508089 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:09.508544 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:09.712594 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:09.720840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6c320422-5d89-4f87-9eba-52c5c076ef5c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.226325 Jul 11 16:27:09.721488 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1714/3503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:09 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:10.144505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:10.145140 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:10.152339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:10.152803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:10.153632 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:10.154044 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:10.158402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:10.387872 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:10.397217 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-52825683-4c03-41d8-85f4-92a219850205 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.255290 Jul 11 16:27:10.403684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1790/3504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:10 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:10.738300 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:10.738916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:10.745873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:10.746296 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:10.747060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:10.747667 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:10.960415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:10.969693 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9fc1f35c-f70a-468c-84c5-af67362115e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.235317 Jul 11 16:27:10.970372 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1715/3505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:10 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:11.419063 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:11.420237 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:11.427141 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:11.427584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:11.428371 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:11.428920 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:11.613573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:11.621147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-5d8d429e-c559-43bf-8fbd-5ebbaf631e24 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.205981 Jul 11 16:27:11.621708 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1791/3506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:11 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:11.987282 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:11.991354 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:12.002358 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:12.003071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:12.004094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:12.004617 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:12.171484 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:12.179060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0be914d5-da0a-4bd3-a831-a18868d9f340 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.195557 Jul 11 16:27:12.180694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1716/3507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:11 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:12.638395 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:12.638820 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:12.645817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:12.646534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:12.647409 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:12.647863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:12.788707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:12.797294 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8e4faabe-f6c0-4bee-9bb5-62daf2c7c4de tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.162762 Jul 11 16:27:12.797771 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1792/3508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:12 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:13.195945 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:13.196580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:13.203140 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:13.203946 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:13.204722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:13.205226 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:13.340015 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:13.347722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-273e50b8-65dd-44bf-9cba-e1f70272d3bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.156012 Jul 11 16:27:13.348392 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1717/3509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:13 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:13.815155 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:13.815841 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:13.823083 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:13.823563 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:13.824390 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:13.825122 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:13.964114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:13.972718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-eceab583-a199-42ed-a961-6a60560fed33 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.162382 Jul 11 16:27:13.973365 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1793/3510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:13 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:14.368160 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:14.368920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:14.377084 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:14.379359 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:14.380222 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:14.380688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:14.539090 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:14.548162 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9ad52d7c-1aec-42de-b1cd-c5b7ce3b4b8d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.186080 Jul 11 16:27:14.549006 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1718/3511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:14 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:14.878832 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-7345041c-300b-4983-9529-edfebe0a8445 req-c8e69b85-7fe0-4fab-bc0a-e37a4ebfa304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5478e-f531-4d9f-b1e0-93f12811bc13", "name": "network-vif-plugged", "status": "completed", "tag": "fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:14.890817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7345041c-300b-4983-9529-edfebe0a8445 req-c8e69b85-7fe0-4fab-bc0a-e37a4ebfa304 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:14.890817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-7345041c-300b-4983-9529-edfebe0a8445 req-c8e69b85-7fe0-4fab-bc0a-e37a4ebfa304 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:14.900095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-7345041c-300b-4983-9529-edfebe0a8445 req-c8e69b85-7fe0-4fab-bc0a-e37a4ebfa304 service nova] Creating event network-vif-plugged:fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23 for instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 on hv-cinder-79760 Jul 11 16:27:14.905103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-7345041c-300b-4983-9529-edfebe0a8445 req-c8e69b85-7fe0-4fab-bc0a-e37a4ebfa304 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176264 Jul 11 16:27:14.905825 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1794/3512] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:14.995272 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:14.996083 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:15.005201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:15.006100 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:15.006416 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:15.006953 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:15.011660 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:15.171346 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:15.179279 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06053c85-2556-4631-a333-1cdd6ce40fe0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1314 microversion: 2.1 time: 0.189468 Jul 11 16:27:15.180060 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1719/3513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:14 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:15.566605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:15.567614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:15.574402 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:15.574871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:15.575631 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:15.576071 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:15.713557 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:15.721014 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-039b7b25-24b2-4eb2-859f-18b61d3e65cf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.158606 Jul 11 16:27:15.721568 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1795/3514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:15 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:16.196600 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:16.199128 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:16.206395 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.206846 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.207614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.208052 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.340873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:16.348979 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-18ae727b-0c32-48f8-abaa-f1706b7c5bc2 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1497 microversion: 2.1 time: 0.156366 Jul 11 16:27:16.349556 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1720/3515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:16 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:16.739061 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:16.739679 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:16.742310 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:16.743204 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=10 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:16.750261 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.750846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.751702 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.752231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.779726 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:16.780329 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:16.788094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.788783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.789554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.789990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.816930 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:27:16.906131 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-593963d1-ace4-4352-bbd0-42a54ee1fce0 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 204 len: 0 microversion: 2.1 time: 0.132241 Jul 11 16:27:16.907365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1721/3516] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:27:16 2022] DELETE /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:27:16.913824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:16.916907 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:16.917683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:16.921814 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-aa6f6812-97ac-492b-aaab-3c351faf015d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.187034 Jul 11 16:27:16.922386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1796/3517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:16 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:16.931618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.931618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.931618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.931618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.936793 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-e59a6151-6cfb-4a98-afc9-422f9e41d09b req-11e935c5-4c18-450e-8f81-a35e931b41ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "name": "network-vif-plugged", "status": "completed", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:16.945240 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e59a6151-6cfb-4a98-afc9-422f9e41d09b req-11e935c5-4c18-450e-8f81-a35e931b41ad service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:16.945888 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-e59a6151-6cfb-4a98-afc9-422f9e41d09b req-11e935c5-4c18-450e-8f81-a35e931b41ad service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:16.957523 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-e59a6151-6cfb-4a98-afc9-422f9e41d09b req-11e935c5-4c18-450e-8f81-a35e931b41ad service nova] Creating event network-vif-plugged:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:27:16.962770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-e59a6151-6cfb-4a98-afc9-422f9e41d09b req-11e935c5-4c18-450e-8f81-a35e931b41ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029540 Jul 11 16:27:16.963898 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1797/3518] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:17.075266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:17.083672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fef7bd94-9960-4b8b-a949-f0ea8ce27401 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1503 microversion: 2.1 time: 0.171952 Jul 11 16:27:17.084260 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1722/3519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:16 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:17.939543 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:17.940274 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:17.948403 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:17.948861 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:17.949623 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:17.950175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:18.100662 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:18.101924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:18.112763 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:18.113553 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:18.114509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:18.115393 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:18.124521 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:18.139748 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-39d1fc8a-bc31-4c13-aad2-e4875c894b45 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.204817 Jul 11 16:27:18.140835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1798/3520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:17 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:18.297304 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:18.305497 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4caf5ab2-d645-444e-9998-445f11adcd02 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1503 microversion: 2.1 time: 0.208786 Jul 11 16:27:18.306375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1723/3521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:18 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:19.113028 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-cfa69051-6d88-443b-b5f3-fc54230fbf1d req-6076a926-29b0-4a45-9526-93a3990cc947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5478e-f531-4d9f-b1e0-93f12811bc13", "name": "network-vif-deleted", "tag": "fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:19.122367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-cfa69051-6d88-443b-b5f3-fc54230fbf1d req-6076a926-29b0-4a45-9526-93a3990cc947 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.122939 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-cfa69051-6d88-443b-b5f3-fc54230fbf1d req-6076a926-29b0-4a45-9526-93a3990cc947 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.135546 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-cfa69051-6d88-443b-b5f3-fc54230fbf1d req-6076a926-29b0-4a45-9526-93a3990cc947 service nova] Creating event network-vif-deleted:fdb5fd92-1d98-46a0-9a4b-69b7aab8fc23 for instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 on hv-cinder-79760 Jul 11 16:27:19.140473 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-cfa69051-6d88-443b-b5f3-fc54230fbf1d req-6076a926-29b0-4a45-9526-93a3990cc947 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031416 Jul 11 16:27:19.141256 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1799/3522] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:19.161407 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:19.162001 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:19.164863 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:19.170349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.170881 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.171921 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.172517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.323833 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:19.324790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:19.331637 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:19.332146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.332678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.335989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.335989 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.342873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-36b9c1ab-4bcf-43b4-b4c2-baface47e16e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1259 microversion: 2.1 time: 0.185339 Jul 11 16:27:19.343539 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1724/3523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:19 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:19.374583 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:19.375135 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:19.375633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lazy-loading 'fault' on Instance uuid 6cd5478e-f531-4d9f-b1e0-93f12811bc13 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:27:19.416860 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:19.424203 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d351c189-ab5e-49bd-9c86-5cef8f15f90f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 200 len: 1304 microversion: 2.1 time: 0.104860 Jul 11 16:27:19.424797 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1800/3524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:19 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 16:27:20.359506 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:20.360182 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:20.366526 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.366983 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.367695 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.368120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.441938 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:20.442706 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 6cd5478e-f531-4d9f-b1e0-93f12811bc13] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:20.446945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:20.451248 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.451705 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.452863 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.454658 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.469828 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] HTTP exception thrown: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Request method failure captured: Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 HTTP/1.1 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE9WpOEPID40s5qsiL7DquVB_InFZImxsKmTShJwok0uJQa08GyaMfuSjWfG1jKm9q1qVsar_rt9hHcVF-sGekYs9THQuJEs3yPNgaFczyKrxWVP7iVmIntx9NTc-IxOgEyG85qxzwU00kejcsyIs06dAstmR9YE7P3C6kPO-zBUKXI Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: ce9d90202a824e3689fc7a2538407fd0 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:20.471718 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ce9d90202a824e3689fc7a2538407fd0"}]}] Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: ce9d90202a824e3689fc7a2538407fd0 Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesActionsTest-1467812392-project Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: b701c953ae4f485ba6cefed3178f9951 Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesActionsTest-1467812392-project Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. Jul 11 16:27:20.473075 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '6cd5478e-f531-4d9f-b1e0-93f12811bc13'} Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:20.473817 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. Jul 11 16:27:20.475080 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:20.478584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Returning 404 to user: Instance 6cd5478e-f531-4d9f-b1e0-93f12811bc13 could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:20.478584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bcac3478-5ee0-4c0f-8c08-fe4b40c44a87 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13" status: 404 len: 111 microversion: 2.1 time: 0.037640 Jul 11 16:27:20.478584 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1801/3525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:20 2022] GET /compute/v2.1/servers/6cd5478e-f531-4d9f-b1e0-93f12811bc13 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 16:27:20.526749 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:20.534928 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-081b9ed7-fce2-4950-b0ea-7080e796d65c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1442 microversion: 2.1 time: 0.179734 Jul 11 16:27:20.535614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1725/3526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:20 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:20.552636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:20.553286 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:20.561392 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.561837 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.562595 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:20.563079 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:20.588612 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1273197951", "imageRef": "502bf3cf-19e6-4bb7-b97c-3fe8815e42a6", "flavorRef": "452", "networks": [{"uuid": "db107b29-13df-448e-bcc4-ee1840057a9e"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:20.642147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] validate_networks() for [('db107b29-13df-448e-bcc4-ee1840057a9e', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 16:27:20.787615 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:20.798103 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-492bc786-f784-4de0-a2df-ca0f157ce01e tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1442 microversion: 2.1 time: 0.249678 Jul 11 16:27:20.798915 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1802/3527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:20 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1442 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:21.501810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 16:27:21.502243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 16:27:21.502718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 16:27:21.503129 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 16:27:21.503541 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 16:27:21.514449 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:21.514990 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:21.515937 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:21.516345 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:21.535103 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Getting quotas for project ce9d90202a824e3689fc7a2538407fd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 16:27:21.539365 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Getting quotas for user b701c953ae4f485ba6cefed3178f9951 and project ce9d90202a824e3689fc7a2538407fd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 16:27:21.551375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 16:27:21.554328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502bf3cf-19e6-4bb7-b97c-3fe8815e42a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 16:27:21.603157 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-41d0893e-d0ec-4222-abdd-d78aa914bc51 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018546 Jul 11 16:27:21.604331 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1726/3528] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 16:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 16:27:21.614720 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-804e2367-6d58-4d24-a96a-0cfa7213bafe tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:21.615381 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-804e2367-6d58-4d24-a96a-0cfa7213bafe tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:21.697914 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-804e2367-6d58-4d24-a96a-0cfa7213bafe tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:21.705313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-804e2367-6d58-4d24-a96a-0cfa7213bafe tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1214 microversion: 2.1 time: 0.094615 Jul 11 16:27:21.705879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1803/3529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:21 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:22.723721 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:22.724537 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:22.733339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:22.734130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:22.735415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:22.736840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:22.800912 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:22.808666 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d429350-d41c-45ac-9477-60fc9fa18dfd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1272 microversion: 2.1 time: 0.089615 Jul 11 16:27:22.809321 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1727/3530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:22 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:23.405437 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-f28e2a84-8e15-4133-8f95-69a2377d5d22 req-99700867-13d1-4d0f-b907-e4483889a9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:23.415327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-f28e2a84-8e15-4133-8f95-69a2377d5d22 req-99700867-13d1-4d0f-b907-e4483889a9ce service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:23.415905 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-f28e2a84-8e15-4133-8f95-69a2377d5d22 req-99700867-13d1-4d0f-b907-e4483889a9ce service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:23.440091 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-f28e2a84-8e15-4133-8f95-69a2377d5d22 req-99700867-13d1-4d0f-b907-e4483889a9ce service nova] Creating event network-changed:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:27:23.445770 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-f28e2a84-8e15-4133-8f95-69a2377d5d22 req-99700867-13d1-4d0f-b907-e4483889a9ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044384 Jul 11 16:27:23.446492 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1804/3531] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:23.826105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:23.826658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:23.834036 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:23.834411 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:23.835208 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:23.835633 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:23.971474 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:23.979521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b7c2e276-4692-4ba0-b6bc-9c53aae6f3f8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.157375 Jul 11 16:27:23.980073 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1728/3532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:23 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:25.002678 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:25.003836 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:25.015575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:25.016337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:25.017602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:25.018325 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:25.172776 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:25.181710 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c06fa69c-b352-42b5-b979-68d1453c2b8e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.187090 Jul 11 16:27:25.182289 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1805/3533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:24 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:26.200450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:26.201737 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:26.208955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:26.209517 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:26.210592 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:26.211230 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:26.422067 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:26.435227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4d97272-92b8-43e5-8808-9a79b933699c tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.239901 Jul 11 16:27:26.435934 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1729/3534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:26 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:26.672270 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-af752619-d8d4-42f3-bd3f-1d5e5164dfd6 req-56af2c42-1565-4c3f-b0f4-fbd849cccbff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7735d14e-3f8c-4cfc-af29-4916276cf9df", "tag": "f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:26.682245 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-af752619-d8d4-42f3-bd3f-1d5e5164dfd6 req-56af2c42-1565-4c3f-b0f4-fbd849cccbff service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:26.682803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-af752619-d8d4-42f3-bd3f-1d5e5164dfd6 req-56af2c42-1565-4c3f-b0f4-fbd849cccbff service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:26.700738 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-af752619-d8d4-42f3-bd3f-1d5e5164dfd6 req-56af2c42-1565-4c3f-b0f4-fbd849cccbff service nova] Creating event network-changed:f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480 for instance 7735d14e-3f8c-4cfc-af29-4916276cf9df on hv-cinder-79760 Jul 11 16:27:26.712444 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-af752619-d8d4-42f3-bd3f-1d5e5164dfd6 req-56af2c42-1565-4c3f-b0f4-fbd849cccbff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043944 Jul 11 16:27:26.713058 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1806/3535] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:27.452867 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:27.453831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:27.460748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:27.461284 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:27.462184 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:27.462611 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:27.595756 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:27.604618 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8657d84c-896c-4fe6-9a26-0dec33d7e73f tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.155568 Jul 11 16:27:27.605188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1730/3536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:27 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:28.622790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:28.623498 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:28.630109 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:28.630553 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:28.631306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:28.631735 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:28.764529 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:28.772713 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-3cb3faf0-8cce-41b8-ada2-e29c1fe704bd tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.154989 Jul 11 16:27:28.773288 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1807/3537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:28 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:29.793423 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:29.794045 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:29.801635 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:29.802116 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:29.802917 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:29.803375 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:29.951302 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:29.959511 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-86e37b4f-67eb-4c24-ba90-4b131850c81b tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.171167 Jul 11 16:27:29.960088 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1731/3538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:29 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:30.331885 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-c978c11c-4f55-4bb0-9466-21ae977a6c2e req-52df67a5-c37b-47d3-b4d5-466b1668ef8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7735d14e-3f8c-4cfc-af29-4916276cf9df", "name": "network-vif-plugged", "status": "completed", "tag": "f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:30.340827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c978c11c-4f55-4bb0-9466-21ae977a6c2e req-52df67a5-c37b-47d3-b4d5-466b1668ef8b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:30.341276 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-c978c11c-4f55-4bb0-9466-21ae977a6c2e req-52df67a5-c37b-47d3-b4d5-466b1668ef8b service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:30.353181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-c978c11c-4f55-4bb0-9466-21ae977a6c2e req-52df67a5-c37b-47d3-b4d5-466b1668ef8b service nova] Creating event network-vif-plugged:f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480 for instance 7735d14e-3f8c-4cfc-af29-4916276cf9df on hv-cinder-79760 Jul 11 16:27:30.358167 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-c978c11c-4f55-4bb0-9466-21ae977a6c2e req-52df67a5-c37b-47d3-b4d5-466b1668ef8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030893 Jul 11 16:27:30.359003 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1808/3539] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:30.976680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:30.977575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:30.984000 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:30.984444 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:30.985701 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:30.986271 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:31.123446 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:31.131531 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab16f443-ad17-4a62-96d6-06130c8c8558 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1314 microversion: 2.1 time: 0.159023 Jul 11 16:27:31.132214 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1732/3540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:30 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:32.146803 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell0:SELECT=2 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:32.153647 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:32.154278 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:32.161164 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.161616 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:32.162386 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.162824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:32.302223 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:32.309959 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d338aef3-3dee-4535-99e6-5e04d48744e7 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1497 microversion: 2.1 time: 0.165358 Jul 11 16:27:32.310694 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1809/3541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:32 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:32.775591 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:32.776144 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:32.778012 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:32.779071 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:32.785289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.785289 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:32.786032 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.786463 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:32.813335 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:27:32.848309 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:32.895715 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1ff687cf-221c-4484-8a25-6b6cd04433c5 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 204 len: 0 microversion: 2.1 time: 0.123687 Jul 11 16:27:32.896527 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1733/3542] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:27:32 2022] DELETE /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:27:32.905188 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:32.906055 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:32.912945 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.913394 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:32.914330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:32.914951 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:33.060890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:33.068662 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8386b341-0439-4d25-b8d2-ddc5172ac92e tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1503 microversion: 2.1 time: 0.167723 Jul 11 16:27:33.069306 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1810/3543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:32 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:34.087307 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:34.088683 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:34.095758 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:34.096380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:34.097201 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:34.097625 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:34.292112 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:34.301653 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc196ec7-b1b1-455c-a02e-e5a265ddcfe6 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1503 microversion: 2.1 time: 0.218700 Jul 11 16:27:34.302580 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1734/3544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:34 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:35.157573 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [req-bdccd705-c5d2-43d5-8d56-794a1e0003a7 req-63351c71-8bfc-4f8a-a589-de4101c3f454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7735d14e-3f8c-4cfc-af29-4916276cf9df", "name": "network-vif-deleted", "tag": "f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480"}]} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:27:35.170534 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-bdccd705-c5d2-43d5-8d56-794a1e0003a7 req-63351c71-8bfc-4f8a-a589-de4101c3f454 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:35.170973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [req-bdccd705-c5d2-43d5-8d56-794a1e0003a7 req-63351c71-8bfc-4f8a-a589-de4101c3f454 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:35.185977 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.compute.server_external_events [req-bdccd705-c5d2-43d5-8d56-794a1e0003a7 req-63351c71-8bfc-4f8a-a589-de4101c3f454 service nova] Creating event network-vif-deleted:f3ec7ff8-46b7-4a75-b3ad-ca0bffe64480 for instance 7735d14e-3f8c-4cfc-af29-4916276cf9df on hv-cinder-79760 Jul 11 16:27:35.191181 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [req-bdccd705-c5d2-43d5-8d56-794a1e0003a7 req-63351c71-8bfc-4f8a-a589-de4101c3f454 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039130 Jul 11 16:27:35.194780 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1811/3545] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:27:35.319731 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:35.320373 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:35.326700 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:35.327137 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:35.327873 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:35.328680 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:35.359376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:35.359815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:35.360251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lazy-loading 'fault' on Instance uuid 7735d14e-3f8c-4cfc-af29-4916276cf9df {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:27:35.406798 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701c953ae4f485ba6cefed3178f9951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d90202a824e3689fc7a2538407fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:27:35.417101 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8a1c39f1-ad4a-4333-b7ef-f7b04e0bbff8 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 200 len: 1304 microversion: 2.1 time: 0.101770 Jul 11 16:27:35.417663 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1735/3546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:35 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:27:36.441030 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:27:36.442009 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] [instance: 7735d14e-3f8c-4cfc-af29-4916276cf9df] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:27:36.451343 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:36.451790 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:36.452585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:27:36.453023 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:27:36.467436 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.wsgi [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] HTTP exception thrown: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Request method failure captured: Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: request: GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df HTTP/1.1 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept: application/json Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Accept-Encoding: identity Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Connection: close Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Length: 0 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Content-Type: application/json Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Host: 10.222.0.26 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Openstack-System-Scope: None Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: User-Agent: python-urllib3/1.26.9 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Auth-Token: gAAAAABizE9WpOEPID40s5qsiL7DquVB_InFZImxsKmTShJwok0uJQa08GyaMfuSjWfG1jKm9q1qVsar_rt9hHcVF-sGekYs9THQuJEs3yPNgaFczyKrxWVP7iVmIntx9NTc-IxOgEyG85qxzwU00kejcsyIs06dAstmR9YE7P3C6kPO-zBUKXI Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Id: None Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Domain-Name: None Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Identity-Status: Confirmed Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Is-Admin-Project: True Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Id: default Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Domain-Name: Default Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Id: ce9d90202a824e3689fc7a2538407fd0 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Project-Name: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Role: member,reader Jul 11 16:27:36.469095 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Roles: member,reader Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ce9d90202a824e3689fc7a2538407fd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ce9d90202a824e3689fc7a2538407fd0"}]}] Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Id: ce9d90202a824e3689fc7a2538407fd0 Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-Tenant-Name: tempest-VolumesActionsTest-1467812392 Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User: tempest-VolumesActionsTest-1467812392-project Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Id: default Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Domain-Name: Default Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Id: b701c953ae4f485ba6cefed3178f9951 Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: X-User-Name: tempest-VolumesActionsTest-1467812392-project Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: method: > Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: exception: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. Jul 11 16:27:36.470329 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: action_args: {'id': '7735d14e-3f8c-4cfc-af29-4916276cf9df'} Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:27:36.470973 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. Jul 11 16:27:36.472221 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR nova.api.openstack.wsgi Jul 11 16:27:36.473327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] Returning 404 to user: Instance 7735d14e-3f8c-4cfc-af29-4916276cf9df could not be found. {{(pid=124242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:27:36.473327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-90712aa9-40d5-44b6-9c57-ae9bee41bc42 tempest-VolumesActionsTest-1467812392 tempest-VolumesActionsTest-1467812392-project] 10.222.0.26 "GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df" status: 404 len: 111 microversion: 2.1 time: 0.038248 Jul 11 16:27:36.473327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1812/3547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:27:36 2022] GET /compute/v2.1/servers/7735d14e-3f8c-4cfc-af29-4916276cf9df => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:29:20.929762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 16:29:20.930361 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:20.931120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:20.935767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:29:20.936355 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:20.944412 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:20.944882 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:20.945628 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:20.946049 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:20.972604 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lazy-loading 'flavor' on Instance uuid dcde8e01-d136-409b-8031-f7e436ae25d2 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:29:21.054366 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3caae6d4-bf23-4727-a9b4-5277b743ebc2 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "POST /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2/action" status: 202 len: 0 microversion: 2.1 time: 0.126708 Jul 11 16:29:21.055075 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1736/3548] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 16:29:20 2022] POST /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:29:21.062025 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 16:29:21.064995 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=25 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:21.065755 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=96 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:21.071330 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:21.072214 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:21.081318 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:21.081745 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:21.082520 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:21.082957 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:21.239955 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:21.251041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6dd8e2c5-6fc0-4b37-8ffc-d1b57d75aabf tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.191097 Jul 11 16:29:21.251614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1813/3549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:21 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:22.271059 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:22.271765 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:22.279353 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:22.279810 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:22.280607 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:22.281476 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:22.286916 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f3a3ef5-a58b-4206-828d-19369eea2cb6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55314. Jul 11 16:29:22.427521 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:22.435861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1b936ea-82f3-401e-9a9c-ba9b1b10cfa6 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.169824 Jul 11 16:29:22.436465 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1737/3550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:22 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:23.457871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:23.458864 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:23.473338 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:23.474081 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:23.475367 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:23.476088 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:23.484042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] [844601c3-cb3b-4b2a-8985-8916b0399411] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55318. Jul 11 16:29:23.616859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:23.624485 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-36753ee7-3e00-4432-b51b-e28810173f25 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.173745 Jul 11 16:29:23.625054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1814/3551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:23 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:24.649264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:24.650066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:24.657768 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:24.658209 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:24.659264 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:24.659718 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:24.802111 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:24.814499 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a4bbc2f6-caba-4f4c-b009-d1597a9bc24c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.170630 Jul 11 16:29:24.815266 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1738/3552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:24 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:25.841391 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:25.843341 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:25.849858 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:25.850311 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:25.851144 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:25.851589 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:25.986997 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:25.995086 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-2bd2c0b3-b2fb-4039-a4ad-aa8af4e5662c tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.160662 Jul 11 16:29:25.995630 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1815/3553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:25 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:27.017762 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:27.018328 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:27.025967 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:27.026442 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:27.027241 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:27.027694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:27.183794 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:27.196106 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1916d464-d26b-49e4-9594-93f232d00626 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.184492 Jul 11 16:29:27.196993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1739/3554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:27 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:28.218575 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:28.219192 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:28.226398 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:28.226848 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:28.227633 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:28.228069 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:28.360999 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:28.369052 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-8982c3b6-6f42-42d6-b45a-68a91d03ffe0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.156531 Jul 11 16:29:28.369635 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1816/3555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:28 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:29.390258 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:29.391251 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:29.398672 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:29.399117 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:29.399864 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:29.400325 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:29.539542 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:29.547243 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-384c0284-496a-458d-a22a-ff432f4a948f tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.163577 Jul 11 16:29:29.547874 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1740/3556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:29 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:30.565689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:30.566304 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:30.573313 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:30.573762 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:30.574536 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:30.574941 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:30.709024 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:30.721539 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-ee341ef1-1017-4425-9c09-b1d831fc9489 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.159588 Jul 11 16:29:30.722327 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1817/3557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:30 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:31.748573 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:31.749554 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:31.757215 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:31.757673 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:31.758430 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:31.758892 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:31.892558 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:31.900658 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-320b3e5c-a586-4e9e-b3ba-56358c4ea34d tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.160243 Jul 11 16:29:31.901235 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1741/3558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:31 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:32.921547 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:32.922670 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:32.929845 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:32.930296 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:32.931042 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:32.931505 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:33.068483 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:33.080827 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-dff81d05-1eef-4663-a3fe-7e0f689d35e9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.165896 Jul 11 16:29:33.081401 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1818/3559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:32 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:34.101291 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:34.102205 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:34.112920 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:34.113380 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:34.114216 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:34.114694 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:34.255843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:34.264188 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-accd4704-1198-4435-9f3e-9248aed6aae5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1507 microversion: 2.1 time: 0.169613 Jul 11 16:29:34.264815 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1742/3560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:34 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:34.280922 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:29:34.281470 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:34.288896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:34.289451 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:34.290224 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:34.290740 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:34.384124 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: ERROR oslo.messaging._drivers.impl_rabbit [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [7fbc1036-944a-4233-a061-30e84154e82d] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 16:29:35.394859 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [7fbc1036-944a-4233-a061-30e84154e82d] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55344. Jul 11 16:29:35.400835 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-467ffede-6afb-4b8d-96ad-2fc895487513 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "POST /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2/action" status: 202 len: 0 microversion: 2.1 time: 1.123605 Jul 11 16:29:35.401824 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1819/3561] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 16:29:34 2022] POST /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 16:29:35.412818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:35.413362 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:35.420054 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:35.420538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:35.421297 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:35.421691 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:35.590405 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:35.598493 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c1df9d0-21ce-4e0c-aa3b-e0262dbb74bc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1515 microversion: 2.1 time: 0.190229 Jul 11 16:29:35.599066 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1743/3562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:35 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:35.765255 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:29:35.765432 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:29:36.620185 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:36.621531 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:36.630585 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:36.631125 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:36.632699 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:36.633337 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:36.702955 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-14401d82-900e-44b4-89bb-fcfe720006ee req-20b083d0-f5ec-468d-947b-d25e666b1720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "name": "network-vif-unplugged", "status": "completed", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:29:36.715247 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-14401d82-900e-44b4-89bb-fcfe720006ee req-20b083d0-f5ec-468d-947b-d25e666b1720 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:36.715744 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-14401d82-900e-44b4-89bb-fcfe720006ee req-20b083d0-f5ec-468d-947b-d25e666b1720 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:36.734599 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.compute.server_external_events [req-14401d82-900e-44b4-89bb-fcfe720006ee req-20b083d0-f5ec-468d-947b-d25e666b1720 service nova] Unable to find a host for instance dcde8e01-d136-409b-8031-f7e436ae25d2. Dropping event network-vif-unplugged {{(pid=124241) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 16:29:36.735809 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-14401d82-900e-44b4-89bb-fcfe720006ee req-20b083d0-f5ec-468d-947b-d25e666b1720 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039175 Jul 11 16:29:36.736924 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1744/3563] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 16:29:36.787975 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:36.795548 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-e15f07bb-8c06-4bf0-99b4-1e440943c8ee tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1517 microversion: 2.1 time: 0.180239 Jul 11 16:29:36.802084 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1820/3564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:36 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:37.817813 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:37.818840 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:37.830255 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:37.831004 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:37.832688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:37.833217 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:37.981993 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:37.989831 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e521832e-aebf-4a8f-8fa0-812cee49fbc0 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.178837 Jul 11 16:29:37.990415 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1745/3565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:37 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:39.011475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:39.012344 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:39.023448 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:39.024159 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:39.025475 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:39.026186 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:39.167524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:39.175152 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-c00d7786-536a-458e-8f16-598626bc50fc tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.170273 Jul 11 16:29:39.175871 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1821/3566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:39 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:40.197891 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:40.198880 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:40.209396 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:40.209861 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:40.210614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:40.211042 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:40.359232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:40.367549 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-97c6d77b-48b2-4e68-8130-7f96ffecc7ed tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.177710 Jul 11 16:29:40.368094 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1746/3567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:40 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:41.387870 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:41.388524 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:41.397502 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:41.397952 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:41.398714 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:41.399146 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:41.543846 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:41.554336 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a40c16ef-7ae5-402e-a860-7bd887f64919 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.172706 Jul 11 16:29:41.554877 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1822/3568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:41 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:42.575754 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:42.576818 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:42.588780 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:42.589538 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:42.590783 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:42.591507 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:42.738044 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:42.746263 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70d36f7f-3d83-4940-9890-74ca6b16f2f5 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.177006 Jul 11 16:29:42.746837 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1747/3569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:42 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:43.765482 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:43.766041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:43.773609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:43.774057 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:43.774806 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:43.775235 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:43.921566 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:43.929614 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-d6ac5a4f-bdc0-47be-8e76-3cd71a8dbf60 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.170063 Jul 11 16:29:43.930154 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1823/3570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:43 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:44.955387 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:44.956376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:44.967418 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:44.968156 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:44.969436 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:44.970146 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:45.112655 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:45.120748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77153fd3-ee48-41d9-b5b7-f5423c38492b tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.172137 Jul 11 16:29:45.121314 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1748/3571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:44 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:46.139123 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:46.139690 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:46.146984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:46.147426 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:46.148175 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:46.148636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:46.292363 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:46.303605 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-6e329f6e-53fb-44b9-9f72-ad2ffb1fcb80 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.168826 Jul 11 16:29:46.304427 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1824/3572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:46 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:47.326147 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:47.326772 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:47.334194 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:47.334583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:47.335339 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:47.335767 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:47.473053 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:47.480738 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d254501b-54af-465c-b94e-2e42aa5bde91 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.158537 Jul 11 16:29:47.481310 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1749/3573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:47 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:48.501933 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:48.502478 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:48.510356 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:48.510796 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:48.511552 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:48.511980 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:48.648669 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:48.657114 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-006d8ac0-43a0-4ade-b921-0413f3093045 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.161458 Jul 11 16:29:48.657689 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1825/3574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:48 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:48.831722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-a84037ea-c129-417b-9b28-504476a66d11 req-d5fb1bd7-17ac-4656-adc6-b3997c472f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "name": "network-vif-plugged", "status": "completed", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:29:48.842105 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-a84037ea-c129-417b-9b28-504476a66d11 req-d5fb1bd7-17ac-4656-adc6-b3997c472f98 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:48.842776 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-a84037ea-c129-417b-9b28-504476a66d11 req-d5fb1bd7-17ac-4656-adc6-b3997c472f98 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:48.856887 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-a84037ea-c129-417b-9b28-504476a66d11 req-d5fb1bd7-17ac-4656-adc6-b3997c472f98 service nova] Creating event network-vif-plugged:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:29:48.862081 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-a84037ea-c129-417b-9b28-504476a66d11 req-d5fb1bd7-17ac-4656-adc6-b3997c472f98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034465 Jul 11 16:29:48.862835 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1750/3575] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:29:49.683201 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:49.684202 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:49.695510 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:49.696275 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:49.697636 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:49.698375 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:49.841707 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:49.852257 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-615161c4-80a5-42aa-ace2-39f0d1cb295a tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1573 microversion: 2.1 time: 0.175497 Jul 11 16:29:49.852896 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1826/3576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:49 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:50.508720 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:29:50.509399 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:29:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:29:50.875158 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:29:50.876376 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:29:50.886483 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:50.886927 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:50.887688 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:29:50.888120 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:29:51.038023 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:29:51.040313 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:51.047722 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-71e79022-4e16-48df-bfb7-f742ea0bb764 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1560 microversion: 2.1 time: 0.180434 Jul 11 16:29:51.048283 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1751/3577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:29:50 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:29:57.392185 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:29:57.393237 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:30:10.630446 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:30:10.631466 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:31:03.674118 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_api:SELECT=30 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:03.675147 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG dbcounter [-] [124242] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:03.677422 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=32 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:03.680041 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:03.680620 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:31:03.681843 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-50fd1eca-a6bb-493c-9dee-ab18dc3b33bd req-2b21968a-a657-4b01-a586-dd2755e9d5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:31:03.689349 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:03.689879 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:03.690890 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:03.691205 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:03.692142 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-50fd1eca-a6bb-493c-9dee-ab18dc3b33bd req-2b21968a-a657-4b01-a586-dd2755e9d5a1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:03.693179 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-50fd1eca-a6bb-493c-9dee-ab18dc3b33bd req-2b21968a-a657-4b01-a586-dd2755e9d5a1 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:03.705706 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-50fd1eca-a6bb-493c-9dee-ab18dc3b33bd req-2b21968a-a657-4b01-a586-dd2755e9d5a1 service nova] Creating event network-changed:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:31:03.711833 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-50fd1eca-a6bb-493c-9dee-ab18dc3b33bd req-2b21968a-a657-4b01-a586-dd2755e9d5a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037344 Jul 11 16:31:03.712755 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1752/3578] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:31:03.719173 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Going to try to terminate instance {{(pid=124242) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 16:31:03.815609 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-acff605c-819b-4f11-b275-bbbb62b908d9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 204 len: 0 microversion: 2.1 time: 0.143110 Jul 11 16:31:03.816528 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1827/3579] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 16:31:03 2022] DELETE /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 16:31:03.825232 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:03.825932 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:31:03.832583 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:03.833125 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:03.833886 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:03.834319 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:03.968787 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:31:03.976943 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dfc54288-be0b-4416-9276-8b728afb02a9 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.155936 Jul 11 16:31:03.985797 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1753/3580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:31:03 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:31:04.995074 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:04.995750 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:31:05.002602 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:05.003054 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:05.003812 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:05.004586 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:05.144499 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:31:05.156160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-bb185c97-7a4f-4e76-a1ba-f0f13ffad3a1 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1566 microversion: 2.1 time: 0.165067 Jul 11 16:31:05.156978 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1828/3581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:31:04 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:31:05.854471 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-08eebc6e-3cac-4cef-9ef2-d64dba64ec89 req-27d161a0-b697-437f-8178-2b19e5430de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcde8e01-d136-409b-8031-f7e436ae25d2", "name": "network-vif-deleted", "tag": "30f5d096-3ce9-4794-bc41-f21324f63e73"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 16:31:05.862489 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-08eebc6e-3cac-4cef-9ef2-d64dba64ec89 req-27d161a0-b697-437f-8178-2b19e5430de9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:05.862925 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-08eebc6e-3cac-4cef-9ef2-d64dba64ec89 req-27d161a0-b697-437f-8178-2b19e5430de9 service nova] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:05.873748 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-08eebc6e-3cac-4cef-9ef2-d64dba64ec89 req-27d161a0-b697-437f-8178-2b19e5430de9 service nova] Creating event network-vif-deleted:30f5d096-3ce9-4794-bc41-f21324f63e73 for instance dcde8e01-d136-409b-8031-f7e436ae25d2 on hv-cinder-79760 Jul 11 16:31:05.878631 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-08eebc6e-3cac-4cef-9ef2-d64dba64ec89 req-27d161a0-b697-437f-8178-2b19e5430de9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115852 Jul 11 16:31:05.879394 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1754/3582] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 16:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 16:31:06.178984 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:06.179591 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.compute.api [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124242) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:31:06.191684 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:06.192435 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:06.193450 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:06.194292 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:06.228269 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:06.228774 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG oslo_concurrency.lockutils [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:06.229231 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.objects.instance [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lazy-loading 'fault' on Instance uuid dcde8e01-d136-409b-8031-f7e436ae25d2 {{(pid=124242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 16:31:06.270886 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.policy [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b01ee6b70b4da38f9735df5ecc0d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f80256e12d4678ac08717e16368e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124242) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 16:31:06.278844 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-a5fadb5d-ce48-4ff7-b51e-9543ae4f21d8 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 200 len: 1224 microversion: 2.1 time: 0.104427 Jul 11 16:31:06.279406 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1829/3583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:31:06 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 16:31:07.302679 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:07.303390 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] [instance: dcde8e01-d136-409b-8031-f7e436ae25d2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 16:31:07.312862 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:07.313414 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:07.314509 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 16:31:07.315130 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Lock "39cfca4d-45cc-4bb7-beae-846c4ae6fa69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 16:31:07.334614 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] HTTP exception thrown: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Request method failure captured: Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 HTTP/1.1 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept: application/json Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Connection: close Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Length: 0 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Content-Type: application/json Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Host: 10.222.0.26 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABizE8rKPHfMGtvbGeDzke8AhBlySmkUVWGFKSAiq9BIImfrJmh0hrzZJbL49VSwwdDqHDu9OwTT-TYyjEVsHseEzVJ3WGEjkppsrbzWijJPIbXtrJqTpzrzeUm1__KAp_TKWBPC7sGBqNo7ZfBEAzSmxrQCLLMJkysMN7L9Z53alg0n4M Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Id: None Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Domain-Name: None Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Id: 15f80256e12d4678ac08717e16368e64 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestShelveInstance-1577243888 Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Role: member,reader Jul 11 16:31:07.336227 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Roles: member,reader Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15f80256e12d4678ac08717e16368e64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15f80256e12d4678ac08717e16368e64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15f80256e12d4678ac08717e16368e64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15f80256e12d4678ac08717e16368e64"}]}] Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestShelveInstance-1577243888 Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 15f80256e12d4678ac08717e16368e64 Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestShelveInstance-1577243888 Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User: tempest-TestShelveInstance-1577243888-project Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Id: 46b01ee6b70b4da38f9735df5ecc0d1c Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestShelveInstance-1577243888-project Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: method: > Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: exception: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. Jul 11 16:31:07.337575 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: action_args: {'id': 'dcde8e01-d136-409b-8031-f7e436ae25d2'} Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 16:31:07.338487 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. Jul 11 16:31:07.339995 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Jul 11 16:31:07.341821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Returning 404 to user: Instance dcde8e01-d136-409b-8031-f7e436ae25d2 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 16:31:07.341821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d8456e0a-8de9-4c6a-a704-fd0075de3338 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2" status: 404 len: 111 microversion: 2.1 time: 0.042270 Jul 11 16:31:07.341821 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1755/3584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 16:31:07 2022] GET /compute/v2.1/servers/dcde8e01-d136-409b-8031-f7e436ae25d2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 16:31:07.500067 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: DEBUG nova.api.openstack.wsgi [None req-341813f4-13c0-4e9e-9802-d719a6d39111 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] Calling method '.version_select at 0x7f20b336cca0>' {{(pid=124242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 16:31:07.524160 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO nova.api.openstack.requestlog [None req-341813f4-13c0-4e9e-9802-d719a6d39111 tempest-TestShelveInstance-1577243888 tempest-TestShelveInstance-1577243888-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1595576547" status: 202 len: 0 microversion: 2.1 time: 0.027939 Jul 11 16:31:07.524716 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: [pid: 124242|app: 0|req: 1830/3585] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 11 16:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1595576547 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 16:33:10.520450 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:33:10.521349 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:33:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:33:17.405002 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:33:17.406093 dv-cinder-797608-53-iscsi devstack@n-api.service[124241]: Mon Jul 11 16:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:33:30.644339 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:33:30.645280 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:34:56.916601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:34:56.916601 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:34:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 16:36:15.779555 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 16:36:15.780461 dv-cinder-797608-53-iscsi devstack@n-api.service[124242]: Mon Jul 11 16:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!